-- Logs begin at Wed 2022-10-05 13:31:35 UTC, end at Wed 2022-10-05 14:27:49 UTC. -- Oct 05 14:02:36.341783 dv-cinder-835878-4-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 14:02:36.348928 dv-cinder-835878-4-smb devstack@n-api.service[105596]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 14:02:36 2022] *** Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: nodename: dv-cinder-835878-4-smb Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: machine: x86_64 Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: clock source: unix Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: pcre jit disabled Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: detected number of CPU cores: 4 Oct 05 14:02:36.351006 dv-cinder-835878-4-smb devstack@n-api.service[105596]: current working directory: / Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: detected binary path: /usr/bin/uwsgi-core Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: your processes number limit is 47680 Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: your memory page size is 4096 bytes Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: detected max file descriptor number: 2048 Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: lock engine: pthread robust mutexes Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: thunder lock: enabled Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 14:02:36.351623 dv-cinder-835878-4-smb devstack@n-api.service[105596]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 14:02:36.392146 dv-cinder-835878-4-smb devstack@n-api.service[105596]: Python main interpreter initialized at 0x5567927239c0 Oct 05 14:02:36.392146 dv-cinder-835878-4-smb devstack@n-api.service[105596]: python threads support enabled Oct 05 14:02:36.392146 dv-cinder-835878-4-smb devstack@n-api.service[105596]: your server socket listen backlog is limited to 100 connections Oct 05 14:02:36.392146 dv-cinder-835878-4-smb devstack@n-api.service[105596]: your mercy for graceful operations on workers is 90 seconds Oct 05 14:02:36.392513 dv-cinder-835878-4-smb devstack@n-api.service[105596]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 14:02:36.392594 dv-cinder-835878-4-smb devstack@n-api.service[105596]: *** Operational MODE: preforking *** Oct 05 14:02:36.392838 dv-cinder-835878-4-smb devstack@n-api.service[105596]: *** uWSGI is running in multiple interpreter mode *** Oct 05 14:02:36.392838 dv-cinder-835878-4-smb devstack@n-api.service[105596]: spawned uWSGI master process (pid: 105596) Oct 05 14:02:36.393030 dv-cinder-835878-4-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 05 14:02:36.393602 dv-cinder-835878-4-smb devstack@n-api.service[105596]: spawned uWSGI worker 1 (pid: 105597, cores: 1) Oct 05 14:02:36.393941 dv-cinder-835878-4-smb devstack@n-api.service[105596]: spawned uWSGI worker 2 (pid: 105598, cores: 1) Oct 05 14:02:36.394081 dv-cinder-835878-4-smb devstack@n-api.service[105596]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 14:02:37.055472 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 14:02:37.063315 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 14:02:38.158937 dv-cinder-835878-4-smb devstack@n-api.service[105597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:02:38.158937 dv-cinder-835878-4-smb devstack@n-api.service[105597]: from cryptography.utils import int_from_bytes Oct 05 14:02:38.159485 dv-cinder-835878-4-smb devstack@n-api.service[105598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:02:38.159485 dv-cinder-835878-4-smb devstack@n-api.service[105598]: from cryptography.utils import int_from_bytes Oct 05 14:02:38.159485 dv-cinder-835878-4-smb devstack@n-api.service[105598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:02:38.159485 dv-cinder-835878-4-smb devstack@n-api.service[105598]: from cryptography.utils import int_from_bytes Oct 05 14:02:38.159959 dv-cinder-835878-4-smb devstack@n-api.service[105597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:02:38.159959 dv-cinder-835878-4-smb devstack@n-api.service[105597]: from cryptography.utils import int_from_bytes Oct 05 14:02:40.669324 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 14:02:40.669883 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 14:02:40.670008 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 14:02:40.670356 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 14:02:40.670428 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 14:02:40.670503 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 14:02:40.670668 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 14:02:40.670763 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 14:02:40.671025 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 14:02:40.671123 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.671283 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 14:02:40.671378 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.671651 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.671743 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.671971 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.672070 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.672297 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.672389 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.672605 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.672694 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.672925 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673029 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673264 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673410 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673587 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673687 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673847 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.673936 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.674162 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.674256 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.674475 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.674574 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-4-smb {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.674792 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.674881 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.675096 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.675182 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-4-smb {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.675405 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.675502 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.675725 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.675829 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676025 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676118 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676343 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676435 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676648 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676735 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.676975 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.677143 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.677567 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.677673 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.677813 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.677920 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.678127 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.678215 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.678437 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.678633 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.678772 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.678853 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.679075 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.679171 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.679388 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.679479 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.679697 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.679791 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680015 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680106 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680322 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680419 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680644 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680736 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-4-smb {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.680953 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.681046 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.681359 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.681448 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-4-smb {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.681680 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.681775 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.681994 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.682080 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.682311 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.682422 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.682689 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.682783 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683011 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683107 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683323 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683454 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683630 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683717 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.683983 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.684082 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.684307 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.684393 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.684626 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.684720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.684947 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685045 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685270 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685384 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685582 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685673 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685889 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.685984 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.686267 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.686373 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.686501 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.686593 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.686805 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.686900 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687056 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687148 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687363 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687449 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687645 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687731 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.687955 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688040 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688279 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688365 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688533 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688627 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688784 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.688910 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.689103 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.689241 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.689431 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.689535 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.689741 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.689831 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690049 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690145 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690353 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690439 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690657 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690741 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.690977 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691110 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691267 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691360 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691572 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691736 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691875 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.691967 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.692178 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.692268 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.692485 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.692583 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.692804 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.692887 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.693111 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.693207 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.693457 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.693566 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.693770 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.693868 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.694088 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.694179 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.694393 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.694489 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.694721 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.694812 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695030 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695133 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695336 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695433 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695656 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695751 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.695974 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696072 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696277 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696369 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696583 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696670 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696888 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.696972 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.697197 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.697356 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.697525 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.697626 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.697847 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.697933 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.698096 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.698182 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.698398 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.698492 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.698702 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.698793 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699006 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699100 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699307 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699387 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699640 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699745 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.699945 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700037 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700245 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700331 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700550 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700643 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700854 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.700940 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.701157 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.701275 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.701489 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.701598 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.701793 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.701879 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.702097 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.702182 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.702398 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.702493 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.702702 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.702794 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703005 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703095 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703308 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703403 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703612 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703698 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.703920 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704026 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704222 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704315 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704525 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704624 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704828 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.704915 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.705132 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.705256 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.705461 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.705551 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.705770 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.705862 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706070 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706163 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706382 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706467 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706685 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706771 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.706988 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707083 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707305 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707392 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707607 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707691 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707906 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.707992 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.708218 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.708303 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.708515 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.708600 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.708820 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.708915 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.709122 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.709396 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.709487 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.709609 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.709745 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.709839 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710045 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710137 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710345 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710432 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710645 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710731 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.710948 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711035 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711247 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711339 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711549 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711641 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711845 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.711929 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.712145 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.712239 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.712445 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.712539 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.712757 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.712849 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.713062 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.713157 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.713393 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.713480 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.713701 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.713797 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.714009 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.714121 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.714328 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:02:40.714417 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.714664 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.714757 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.714980 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.715592 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.715845 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.715934 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.716173 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.716265 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.716492 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.716583 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.716804 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.716889 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.717116 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.717202 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.717465 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.717554 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.717775 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.717867 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.718088 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.718187 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.718400 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.718485 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.718711 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.718794 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719025 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719208 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719344 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719433 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719662 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719752 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.719978 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.720076 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.720296 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.720382 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.720610 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.720697 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.720926 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721023 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721252 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721390 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721577 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721664 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721890 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.721985 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.722218 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.722303 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.722536 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.722621 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.722864 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.722964 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.723189 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.723276 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.723511 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.723610 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.723825 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.723919 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.724139 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.724237 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.724448 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.724534 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.724792 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.724879 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.725104 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.725191 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.725441 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.725527 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.725763 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.725851 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.726074 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.726170 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.726394 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.726483 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.726707 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.726802 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727019 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727106 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727331 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727428 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727643 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727731 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.727951 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728043 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728261 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728355 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728573 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728665 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728901 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.728999 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.729215 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.729350 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.729548 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.729641 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.729868 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.729954 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.730177 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.730277 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.730489 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.730582 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.731373 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.731478 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.731686 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.731782 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.731994 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.732080 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.732298 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.732397 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.732609 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.732696 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.732916 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733014 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733251 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733458 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733558 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733646 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733873 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.733967 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.734207 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.734326 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.734520 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.734622 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.734856 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.734956 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.735166 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.735262 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.735476 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.735572 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.735780 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.735878 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.736091 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.736202 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.736400 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.736495 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.736706 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.736801 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.737018 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.737122 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.737606 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.737705 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.737916 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738026 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738234 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738338 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738537 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738632 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738845 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.738941 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.739151 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.739260 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.739458 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.739553 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.739768 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.739878 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.740080 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.740189 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.740387 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.740484 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.740700 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.740792 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741008 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741094 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741338 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741438 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741656 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741744 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.741970 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.742071 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.742285 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.742370 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.742607 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.742700 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.742920 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743007 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743233 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743324 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743536 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743631 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743845 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.743930 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.744150 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.744250 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.744461 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.744568 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.744764 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.744850 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.745070 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.745167 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.745399 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.745506 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.745702 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.745786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746004 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746100 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746323 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746431 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746634 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746738 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.746935 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747019 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747240 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747335 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747541 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747626 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747842 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.747929 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.748142 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.748230 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.748448 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.748540 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.748752 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.748840 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.749098 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.749186 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.749438 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.749527 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.749766 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.749851 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.750089 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.750224 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.750402 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.750489 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.750720 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.750816 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751032 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751118 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751340 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751423 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751651 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751749 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.751960 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752053 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752270 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752354 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752578 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752670 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752895 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.752980 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.753203 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.753348 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.753550 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.753647 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.753860 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.753945 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.754175 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.754260 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.754480 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.754574 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.754796 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.754891 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.755101 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.755186 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.755420 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.755515 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.755755 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.755840 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.756083 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.756228 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.756376 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.756510 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.756691 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.756822 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757002 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757151 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757357 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757487 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757621 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757754 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.757926 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758061 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758237 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758378 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758677 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758858 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.758998 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.759165 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.759302 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.759481 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.759620 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.759786 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.759928 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.760103 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.760240 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.760407 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.760544 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.760720 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.760857 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.761027 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.761167 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.761367 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.761500 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.761695 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.761836 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762032 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762163 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762353 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762482 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762664 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762801 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.762975 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.763120 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.763286 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.763417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.763591 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.763723 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.763898 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764028 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764203 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764347 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764515 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764667 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764825 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.764965 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.765135 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.765308 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.765463 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.765601 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.765771 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.765914 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766082 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766235 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766384 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766520 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766680 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766829 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.766977 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.767145 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.767281 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.767415 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.767594 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.767737 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.767904 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768058 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768227 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768404 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768545 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768680 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768821 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.768965 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.769140 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.769318 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.769471 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.769611 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.769774 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.769916 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.770081 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.770223 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.770387 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.770516 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.770694 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.770823 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771002 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771145 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771318 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771458 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771670 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771806 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.771935 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.772067 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.772245 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.772379 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.772563 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.772705 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.772873 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773017 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773182 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773331 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773519 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773655 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773834 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.773971 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.774141 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.774292 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.774453 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.774587 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.774761 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.774894 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.775069 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.775211 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.775380 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.775514 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.775692 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.775825 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776000 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776142 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776310 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776444 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776618 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776752 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.776924 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.777069 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.777390 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.777498 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.778092 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.778177 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.778380 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.778639 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.778726 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.778970 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.779292 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.779392 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.779582 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.779671 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.779899 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.779993 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.780220 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.780322 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.780552 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.780677 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.780877 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.780986 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.781187 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.781306 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.781518 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.781611 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.781827 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.781935 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.782140 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.782235 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.782444 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.782536 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.782748 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.782839 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783049 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783139 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783354 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783456 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783658 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783750 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.783966 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.784057 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.784269 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.784361 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.784574 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.784666 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785398 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785487 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785582 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785665 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785665 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785810 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785889 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.785967 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.786083 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.786238 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.786383 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.786473 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.786695 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.786792 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787099 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787306 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787610 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787696 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.787913 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788008 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788216 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788301 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788525 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788612 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788867 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.788961 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.789172 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.789305 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.789539 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.789650 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.789840 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.789934 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.790144 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.790231 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.790466 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.790564 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.790772 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.790861 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791074 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791168 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791374 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791470 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791684 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791769 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.791990 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792076 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792290 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792392 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792599 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792692 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792904 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.792992 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.793266 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.793861 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.794089 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.794186 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.794391 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.794478 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.794698 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795001 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795093 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795314 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795619 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795706 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.795919 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796006 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796219 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796387 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796522 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796607 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796826 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.796912 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.797128 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.797274 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.797484 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.797571 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.797785 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.797869 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.798095 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.798190 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.798397 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.798482 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.798699 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.798784 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799001 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799097 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799305 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799391 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799615 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799726 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.799914 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800003 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800223 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800310 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800528 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800618 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800832 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.800938 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.801134 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.801250 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.801464 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.801551 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.801766 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.801862 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802073 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802167 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802380 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802478 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802682 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802779 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.802993 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803081 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803292 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803387 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803600 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803689 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803902 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.803989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.804205 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.804301 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.804508 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.804595 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.804811 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.804896 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.805114 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.805213 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.805439 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.805535 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.805741 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.805837 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806044 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806139 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806343 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806430 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806646 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806731 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.806953 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807042 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807252 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807357 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807555 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807642 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807856 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.807945 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.808159 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.808244 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.808464 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.808560 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.808826 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.809441 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.809668 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.809931 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.810030 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.810284 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.810381 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.810594 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.810690 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.810907 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811060 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811211 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811362 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811509 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811640 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811804 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.811943 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.812116 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.812253 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.812422 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.812565 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.812724 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.812853 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813026 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813162 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813354 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813452 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813658 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813748 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.813965 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.814052 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.814284 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.814371 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.814594 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.814679 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.814905 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815000 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815206 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815299 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815514 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815609 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815822 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.815916 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.816129 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.816216 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.816437 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.816530 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.816744 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.816829 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.817052 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.817144 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.817383 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.817522 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.817695 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.817780 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818000 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818092 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818308 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818403 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818613 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818707 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.818924 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819017 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819230 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819324 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819534 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819621 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819849 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.819956 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.820157 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.820256 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.820459 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.820556 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.820766 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.820861 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.821073 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.821178 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.821406 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.821503 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.821708 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.821795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.822013 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.822141 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.822327 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.822451 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.822637 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.822762 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823064 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823159 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823372 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823467 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823682 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823776 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.823996 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.824091 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.824305 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.824397 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.825156 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.825297 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.825501 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.825597 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.825819 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.825909 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.826128 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.826296 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.826495 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.826589 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.826800 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.826888 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.827103 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.827192 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.827410 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.827499 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.827736 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.827831 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828039 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828127 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828339 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828436 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828642 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828731 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.828957 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.829046 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.829285 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.829378 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.829595 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.829683 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.829919 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.830064 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.830226 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.830376 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.830549 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.830684 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.830968 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.831099 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.831294 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.831412 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.831580 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.831723 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.831999 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.832088 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.832315 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.832418 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.832629 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.832718 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.832955 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.833051 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.833285 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.833387 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.833600 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.833701 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.833922 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834025 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834238 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834326 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834545 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834640 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834860 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.834957 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.835167 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.835255 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.835480 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.835575 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.835801 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.835903 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.836111 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.836201 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.836432 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.836528 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.836757 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.836848 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.837073 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.837160 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.837422 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.837515 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.837792 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.837887 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.838118 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.838205 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.838423 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.838509 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.838729 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.838819 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839041 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839130 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839346 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839443 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839653 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839740 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.839968 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.840096 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.840301 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.840742 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.840742 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.840903 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.840903 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841050 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841214 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841364 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841529 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841617 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841834 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.841919 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.842147 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.842242 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.842453 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.842547 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.842760 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.842919 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.843063 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.843213 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.843379 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.843515 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.843699 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.843834 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844006 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844145 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844329 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844468 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844638 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844783 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.844926 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845061 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845216 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845346 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845546 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845635 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845871 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.845960 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.846181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.846270 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.846488 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.846584 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.846815 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.846901 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.847126 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.847224 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.847442 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.847538 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.847772 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.847859 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.848098 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.848183 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.848408 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.848504 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.848720 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.848806 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.849039 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.849127 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.849388 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.849493 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.849697 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.849793 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850004 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850137 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850316 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850409 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850622 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850709 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.850926 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851012 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851230 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851345 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851533 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851622 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851837 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.851925 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.852142 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.852239 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.852443 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.852530 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.852747 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.852833 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.853054 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.853151 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.853399 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.853491 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.853697 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.853800 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854001 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854089 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854308 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854395 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854612 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854709 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.854917 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.855004 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.855227 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.855322 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.855532 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.855633 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.856376 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.856466 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.856691 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.856786 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857009 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857097 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857343 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857433 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857657 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857755 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.857974 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.858068 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.858288 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.858376 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.858602 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.858690 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.858915 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859003 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859225 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859313 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859539 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859627 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859852 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.859942 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.860162 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.860257 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.860480 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.860683 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.860785 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.861012 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.861100 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.861350 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.861639 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.861740 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.861969 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.862058 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.862281 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.862617 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.862848 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.862949 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.863160 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.863249 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.863472 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.863559 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.863783 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.863880 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.864095 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.864191 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.864407 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.864496 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.864722 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.864811 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.865036 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.865126 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.865392 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.865484 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.865716 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.865812 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866034 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866120 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866351 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866438 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866670 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866765 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.866988 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.867083 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.867307 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.867405 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.867624 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.867710 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.867942 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868029 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868258 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868347 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868574 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868660 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868888 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.868977 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.869200 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.869349 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.869536 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.869623 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.869849 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.869936 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.870201 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.870339 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.870499 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.870597 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.870780 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.870867 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.871093 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.871181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.871944 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872046 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872263 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872360 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872581 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872669 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872897 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.872982 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.873215 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.873382 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.873555 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.873644 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.873872 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.874076 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.874199 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.874390 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.874520 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.874726 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875043 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875133 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875361 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875451 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875674 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875760 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.875991 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.876081 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.876318 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.876408 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.876625 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.876712 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.876929 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.877018 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.877260 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.877354 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.877573 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.877660 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.877877 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878001 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878190 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878279 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878498 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878591 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878801 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.878898 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.879120 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.879208 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.879429 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.879516 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.879735 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.879960 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.880049 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.880309 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.880447 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.880626 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.880876 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.880974 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.881238 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.881328 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.881566 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.881654 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.881897 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.881988 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.882220 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.882309 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.882528 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.882616 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.882835 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.882924 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.883147 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.883234 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.883455 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.883541 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.883758 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.883846 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884065 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884159 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884376 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884462 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884683 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884773 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.884987 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.885074 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.885320 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.885429 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.885626 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.885715 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.885930 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886016 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886241 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886339 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886630 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886848 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.886944 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.887182 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.887279 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.887487 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.887582 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.887791 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.887885 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.888093 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.888189 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.888396 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.888485 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.888701 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.888796 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889005 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889094 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889331 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889420 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889636 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889722 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.889942 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890030 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890252 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890341 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890561 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890710 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890871 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.890962 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.891193 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.891281 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.891499 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.891588 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.891802 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.891892 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.892127 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.892222 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.892431 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.892517 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.892738 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.892828 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.893052 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.893144 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.893389 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.893503 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.893714 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.893803 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894032 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894118 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894343 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894568 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894905 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.894995 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.895228 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.895530 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.895633 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.895873 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.895961 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.896180 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.896265 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.896489 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.896581 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.896797 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.896897 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.897120 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.897243 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.897459 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.897550 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.897768 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.897855 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.898076 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.898162 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.898386 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.898476 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.898699 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.898800 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899007 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899101 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899316 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899404 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899625 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899712 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.899935 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900031 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900244 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900332 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900553 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900648 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900863 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.900972 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.901171 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.901276 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.901506 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.901593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.901819 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.901918 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.902134 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.902222 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.902451 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.902580 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.902792 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.902897 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.903108 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.903195 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.903426 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.903527 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.903736 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.903825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904045 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904132 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904355 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904443 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904664 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904752 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.904977 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.905064 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.905312 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.905417 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.905628 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.905714 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.905930 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.906023 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.906260 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.906577 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.906671 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.906883 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.906977 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.907211 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.907532 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.907626 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.907844 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.907930 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.908168 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.908263 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.908491 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.908577 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.908797 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.908883 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.909118 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.909204 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.909454 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.909543 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.909775 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.909860 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.910097 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.910184 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.910410 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.910505 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.910737 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.910836 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911046 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911153 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911350 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911437 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911655 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911741 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.911972 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.912069 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.912289 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.912391 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.912600 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.912828 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.912918 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.913137 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.913245 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.913472 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.913631 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.913775 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.913913 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914059 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914203 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914364 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914498 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914664 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914819 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.914955 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915090 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915266 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915410 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915572 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915717 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915860 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.915994 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.916167 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.916305 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.916472 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.916752 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.916900 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.917070 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.917346 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.917440 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.917691 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.917864 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.918001 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.918841 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.918937 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.919151 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.919501 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.919595 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.919762 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.920069 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.920163 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.920403 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.920680 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.920770 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.921041 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.921272 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.921389 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.921703 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.921832 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.922029 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.922343 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.922640 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.922743 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.922979 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.923192 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.923290 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.923596 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.923744 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.923930 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.924163 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.924252 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.924497 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.924584 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.924839 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.924929 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.925151 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.925292 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.925488 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.925578 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.925800 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.925887 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.926127 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.926217 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.926454 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.926541 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.926763 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.926859 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.927090 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.927178 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.927404 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.927497 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.927721 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.927884 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928037 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928126 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928347 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928433 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928657 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928753 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.928978 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.929064 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.929311 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.929404 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.929624 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.929722 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.929936 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930022 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930249 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930338 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930566 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930657 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930881 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.930968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.931191 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.931276 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.931506 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.931595 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.931820 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.931906 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.932133 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.932221 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.932447 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.932537 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.932759 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.932851 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.933078 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.933175 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.933421 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.933510 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.933739 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.933830 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.934621 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.934725 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.934941 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935029 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935260 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935350 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935589 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935686 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935902 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.935989 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.936211 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.936298 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.936458 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 14:02:40.936549 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.936854 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.937200 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.937548 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.937891 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.938221 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.938540 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.938853 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.939159 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:02:40.939404 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 14:02:41.088600 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO dbcounter [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Registered counter for database nova_api Oct 05 14:02:41.091372 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO dbcounter [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Registered counter for database nova_api Oct 05 14:02:41.110706 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.112788 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.117672 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.119185 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.174897 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.context [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab08cad5-af0f-42a8-b6cc-999af6152333(cell1) {{(pid=105597) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 14:02:41.176007 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.context [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab08cad5-af0f-42a8-b6cc-999af6152333(cell1) {{(pid=105598) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 14:02:41.178748 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:02:41.179224 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:02:41.179884 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:02:41.180350 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:02:41.180774 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:02:41.181525 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:02:41.181920 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:02:41.182014 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:02:41.182640 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:02:41.183082 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:02:41.184520 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:02:41.185621 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:02:41.186530 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO dbcounter [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Registered counter for database nova_cell0 Oct 05 14:02:41.187598 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO dbcounter [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Registered counter for database nova_cell0 Oct 05 14:02:41.190518 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO dbcounter [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Registered counter for database nova_cell1 Oct 05 14:02:41.191834 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO dbcounter [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Registered counter for database nova_cell1 Oct 05 14:02:41.197711 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.200813 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.201475 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.202581 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.207371 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.207838 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.209653 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.355468 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.355712 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO dbcounter [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Registered counter for database nova_cell0 Oct 05 14:02:41.365139 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.365753 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO dbcounter [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Registered counter for database nova_cell0 Oct 05 14:02:41.369937 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.372624 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:02:41.377127 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:02:41.708577 dv-cinder-835878-4-smb devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:02:41.710696 dv-cinder-835878-4-smb devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:02:41.716506 dv-cinder-835878-4-smb devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:02:41.718551 dv-cinder-835878-4-smb devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:02:42.057966 dv-cinder-835878-4-smb devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:02:42.062575 dv-cinder-835878-4-smb devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:02:42.064473 dv-cinder-835878-4-smb devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:02:42.068535 dv-cinder-835878-4-smb devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:02:42.070685 dv-cinder-835878-4-smb devstack@n-api.service[105597]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567927239c0 pid: 105597 (default app) Oct 05 14:02:42.072791 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:02:42.073816 dv-cinder-835878-4-smb devstack@n-api.service[105598]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567927239c0 pid: 105598 (default app) Oct 05 14:02:42.073998 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-a04f2008-2708-427c-b9d4-c4bbe6cd21b2 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 Oct 05 14:02:42.074461 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Oct 5 14:02:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:03.309936 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:03.311173 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Oct 05 14:04:03.311569 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:04:03.322602 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=3 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:03.323738 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_cell1:SELECT=3 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:03.324579 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_cell0:SELECT=3 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:03.326703 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:04.187352 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b17c6973-8d49-4bb3-8a26-0d9e926b3f4e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:04.221613 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b17c6973-8d49-4bb3-8a26-0d9e926b3f4e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903903 Oct 05 14:04:04.222981 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 14:04:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:06.839006 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:06.840007 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-233f1f63-ee15-428d-8714-1a92c26adf0e None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 05 14:04:06.840573 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:07.316120 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-29cde467-3bf0-49fa-9ec7-8453b94b97f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:07.363751 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-29cde467-3bf0-49fa-9ec7-8453b94b97f7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.517039 Oct 05 14:04:07.364312 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:04:07.380849 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=3 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:07.383054 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell1:SELECT=3 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:07.383859 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell0:SELECT=3 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:07.385139 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:07.593878 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-c0c10800-cb2a-4736-9278-9dd26b00ee15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:07.660668 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-c0c10800-cb2a-4736-9278-9dd26b00ee15 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287611 Oct 05 14:04:07.661298 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 14:04:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:10.248239 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-29cde467-3bf0-49fa-9ec7-8453b94b97f7 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:10.249269 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-29cde467-3bf0-49fa-9ec7-8453b94b97f7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 05 14:04:10.250109 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:10.903613 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-bd9b53d2-9d21-46ea-9849-e7022c6b3e2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:10.944088 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-bd9b53d2-9d21-46ea-9849-e7022c6b3e2b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688037 Oct 05 14:04:10.944865 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:04:10.956924 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-60a5131c-a16a-40a4-8aaf-cddf584a9231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:10.997462 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-60a5131c-a16a-40a4-8aaf-cddf584a9231 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044058 Oct 05 14:04:10.999034 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 14:04:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:13.598928 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-bd9b53d2-9d21-46ea-9849-e7022c6b3e2b admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:13.599955 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-bd9b53d2-9d21-46ea-9849-e7022c6b3e2b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 05 14:04:13.600354 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:14.020946 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-82d492a0-59e4-464a-944e-9d9f83d8262b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:14.042456 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-82d492a0-59e4-464a-944e-9d9f83d8262b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434541 Oct 05 14:04:14.042957 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:04:14.055156 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-0bbed2c1-e35f-49fc-8f29-edafa35472d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:14.086266 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-0bbed2c1-e35f-49fc-8f29-edafa35472d3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034698 Oct 05 14:04:14.087326 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 14:04:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:16.723429 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-82d492a0-59e4-464a-944e-9d9f83d8262b admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:16.724351 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-82d492a0-59e4-464a-944e-9d9f83d8262b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 05 14:04:16.724763 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:17.147774 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-6c0724d8-1ea8-449e-b2e8-cd541e55bfc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:17.170644 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-6c0724d8-1ea8-449e-b2e8-cd541e55bfc5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439547 Oct 05 14:04:17.173765 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:04:17.184435 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-3f876ee3-a7e0-4a57-aefc-996402ed3974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:17.212882 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-3f876ee3-a7e0-4a57-aefc-996402ed3974 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032617 Oct 05 14:04:17.213536 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 14:04:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:19.890401 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-6c0724d8-1ea8-449e-b2e8-cd541e55bfc5 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:19.891461 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-6c0724d8-1ea8-449e-b2e8-cd541e55bfc5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001771 Oct 05 14:04:19.891939 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:20.287704 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8abc766d-60d3-4123-99af-5fbd89d148fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "vcpus": 4}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:20.307229 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8abc766d-60d3-4123-99af-5fbd89d148fb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.408688 Oct 05 14:04:20.307813 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:04:20.321327 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-a6c5f358-e0be-4ecb-8e71-2618ad714280 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:20.347502 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-a6c5f358-e0be-4ecb-8e71-2618ad714280 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030238 Oct 05 14:04:20.348063 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 14:04:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:23.273772 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8abc766d-60d3-4123-99af-5fbd89d148fb admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:23.275618 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8abc766d-60d3-4123-99af-5fbd89d148fb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Oct 05 14:04:23.276236 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:23.679531 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-0d0686e4-ea83-4d2b-9400-1a30e3a2cc4d admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:23.704625 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-0d0686e4-ea83-4d2b-9400-1a30e3a2cc4d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.421789 Oct 05 14:04:23.705165 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 14:04:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:04:26.374381 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8abc766d-60d3-4123-99af-5fbd89d148fb admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:26.375500 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8abc766d-60d3-4123-99af-5fbd89d148fb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 05 14:04:26.375941 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:26.817534 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-9b8a6392-9ac4-436a-a129-861fa35d3f46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "id": "1", "disk": 1}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:26.839540 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-9b8a6392-9ac4-436a-a129-861fa35d3f46 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457233 Oct 05 14:04:26.840086 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:04:26.853141 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-1e3f38ee-df3c-4b5f-9a97-83ddc3efd60d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:26.883353 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-1e3f38ee-df3c-4b5f-9a97-83ddc3efd60d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034833 Oct 05 14:04:26.884024 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 14:04:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:29.816077 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-9b8a6392-9ac4-436a-a129-861fa35d3f46 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:29.817089 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-9b8a6392-9ac4-436a-a129-861fa35d3f46 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 05 14:04:29.817685 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:30.206930 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-eb94ed3e-ce2a-4538-a87c-88fb1c785059 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "ram": 2048}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:30.226716 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-eb94ed3e-ce2a-4538-a87c-88fb1c785059 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402824 Oct 05 14:04:30.227252 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:04:30.239332 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-140ca72a-bc32-41f5-8323-5f1027a3ddc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:30.264148 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-140ca72a-bc32-41f5-8323-5f1027a3ddc5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028715 Oct 05 14:04:30.264701 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 14:04:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:32.861845 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-eb94ed3e-ce2a-4538-a87c-88fb1c785059 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:32.862847 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-eb94ed3e-ce2a-4538-a87c-88fb1c785059 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 05 14:04:32.863281 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:33.240710 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fc68e35d-503e-45b1-8587-df67017aedd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "id": "3"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:33.263101 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fc68e35d-503e-45b1-8587-df67017aedd8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.393291 Oct 05 14:04:33.263652 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:04:33.275523 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-264df554-c455-41ff-9e6a-39cda3d75562 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:33.302797 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-264df554-c455-41ff-9e6a-39cda3d75562 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030849 Oct 05 14:04:33.303296 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 14:04:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:04:36.016444 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fc68e35d-503e-45b1-8587-df67017aedd8 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:36.017480 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fc68e35d-503e-45b1-8587-df67017aedd8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 05 14:04:36.017875 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:36.471843 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8da36a04-1e95-4e8d-92e0-2501c94ef663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:36.477414 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:36.493815 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8da36a04-1e95-4e8d-92e0-2501c94ef663 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468286 Oct 05 14:04:36.494487 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:04:36.516351 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-646ebe11-05e2-45dd-9879-627c22fa229a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:36.545133 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-646ebe11-05e2-45dd-9879-627c22fa229a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036623 Oct 05 14:04:36.545971 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 14:04:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:04:39.217807 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8da36a04-1e95-4e8d-92e0-2501c94ef663 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:39.218819 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8da36a04-1e95-4e8d-92e0-2501c94ef663 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 05 14:04:39.219413 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:39.657973 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-9472c424-fa56-414a-8a12-b8a5a3f1ddad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:39.664680 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:39.679444 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-9472c424-fa56-414a-8a12-b8a5a3f1ddad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453814 Oct 05 14:04:39.686114 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 14:04:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:04:39.694371 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-989136e9-ccf8-439e-9759-ff96c6bf0099 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:04:39.725919 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-989136e9-ccf8-439e-9759-ff96c6bf0099 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037231 Oct 05 14:04:39.726743 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 14:04:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:04:59.629258 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-9472c424-fa56-414a-8a12-b8a5a3f1ddad admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:04:59.630199 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-9472c424-fa56-414a-8a12-b8a5a3f1ddad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 05 14:04:59.630600 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:04:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:04:59.641465 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:00.016869 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-f5fa9fb0-24a0-4ef5-91a0-1ebe6ee142d0 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:00.034740 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-f5fa9fb0-24a0-4ef5-91a0-1ebe6ee142d0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397809 Oct 05 14:05:00.035267 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 14:04:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:05:01.340449 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-9472c424-fa56-414a-8a12-b8a5a3f1ddad admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:01.341472 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-9472c424-fa56-414a-8a12-b8a5a3f1ddad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 05 14:05:01.341872 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:01.867937 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-f28aae25-d129-4b46-be7c-7bd7a2b14dde admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:01.873765 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.wsgi [None req-f28aae25-d129-4b46-be7c-7bd7a2b14dde admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-f28aae25-d129-4b46-be7c-7bd7a2b14dde admin admin] Request method failure captured: Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Accept: application/json Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Accept-Encoding: gzip, deflate Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Connection: keep-alive Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Content-Length: 0 Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Host: 10.222.0.16 Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Openstack-Api-Version: compute 2.92 Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Openstack-System-Scope: None Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: User-Agent: python-novaclient Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Auth-Token: gAAAAABjPY8NEg2yJuZ4CNBMqWtuzXDT7lA-b5f6EE9TiU9vH7BKeKhKTV5FWzHXs57Drd19aWBXzsAVSNGaTGo8IKhU5tAfw9k0iM_R3BoQVW1cepxBL73KEYyESIiAkzJFEBlBShFj4DqVCX_isJTP6YkMkepfn86Ip72PxqA5Tsa19OKQo6M Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Domain-Id: None Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Domain-Name: None Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Identity-Status: Confirmed Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Is-Admin-Project: True Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Domain-Id: default Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Domain-Name: Default Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Name: admin Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Role: member,admin,reader Oct 05 14:05:01.876991 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Roles: member,admin,reader Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_385992f3807a48ff8e105d88b2b7542e"}]}] Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant: admin Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant-Name: admin Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User: admin Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Domain-Id: default Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Domain-Name: Default Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Id: 1ee0b2255cbf41fe9a777949eff22087 Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Name: admin Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: method: > Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: exception: Flavor 42 could not be found. Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: action_args: {'id': '42'} Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:05:01.878531 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:01.879358 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.880720 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-f28aae25-d129-4b46-be7c-7bd7a2b14dde admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:05:01.882052 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-f28aae25-d129-4b46-be7c-7bd7a2b14dde admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388252 Oct 05 14:05:01.882052 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 14:05:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:01.888222 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-e5832491-dfd1-47d9-8971-7abed409e9f7 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:01.910366 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-e5832491-dfd1-47d9-8971-7abed409e9f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025794 Oct 05 14:05:01.910899 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 14:05:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:05:01.921975 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-951ce175-7c48-42ae-8e49-9c217792aeec admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:01.943909 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-951ce175-7c48-42ae-8e49-9c217792aeec admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026506 Oct 05 14:05:01.944445 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 14:05:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:05:01.953536 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-f73c29cb-4008-4459-9946-8df9f9e28b33 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:01.958748 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.wsgi [None req-f73c29cb-4008-4459-9946-8df9f9e28b33 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-f73c29cb-4008-4459-9946-8df9f9e28b33 admin admin] Request method failure captured: Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Accept: application/json Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Accept-Encoding: gzip, deflate Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Connection: keep-alive Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Content-Length: 0 Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Host: 10.222.0.16 Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Openstack-Api-Version: compute 2.92 Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Openstack-System-Scope: None Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: User-Agent: python-novaclient Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Auth-Token: gAAAAABjPY8NEg2yJuZ4CNBMqWtuzXDT7lA-b5f6EE9TiU9vH7BKeKhKTV5FWzHXs57Drd19aWBXzsAVSNGaTGo8IKhU5tAfw9k0iM_R3BoQVW1cepxBL73KEYyESIiAkzJFEBlBShFj4DqVCX_isJTP6YkMkepfn86Ip72PxqA5Tsa19OKQo6M Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Domain-Id: None Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Domain-Name: None Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Identity-Status: Confirmed Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Is-Admin-Project: True Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Domain-Id: default Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Domain-Name: Default Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Name: admin Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Role: member,admin,reader Oct 05 14:05:01.962003 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Roles: member,admin,reader Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_385992f3807a48ff8e105d88b2b7542e"}]}] Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant: admin Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant-Name: admin Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User: admin Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Domain-Id: default Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Domain-Name: Default Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Id: 1ee0b2255cbf41fe9a777949eff22087 Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Name: admin Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: method: > Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: exception: Flavor 42 could not be found. Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: action_args: {'id': '42'} Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:05:01.963593 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:01.964544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:01.965968 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-f73c29cb-4008-4459-9946-8df9f9e28b33 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:05:01.967178 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-f73c29cb-4008-4459-9946-8df9f9e28b33 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013581 Oct 05 14:05:01.967178 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 14:05:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 14:05:03.194261 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-951ce175-7c48-42ae-8e49-9c217792aeec admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:03.195258 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-951ce175-7c48-42ae-8e49-9c217792aeec admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 05 14:05:03.195654 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:03.718599 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-ebd11595-beb7-4283-8002-678837d0a08f admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:03.723622 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.wsgi [None req-ebd11595-beb7-4283-8002-678837d0a08f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-ebd11595-beb7-4283-8002-678837d0a08f admin admin] Request method failure captured: Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Accept: application/json Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Accept-Encoding: gzip, deflate Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Connection: keep-alive Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Content-Length: 0 Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Host: 10.222.0.16 Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Openstack-Api-Version: compute 2.92 Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Openstack-System-Scope: None Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: User-Agent: python-novaclient Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Auth-Token: gAAAAABjPY8PFD0YMCVWdf1-NoesykHOLbYnINmpPVMK6AHaZgUj6ObL8-PHyGO_Y-BhIpID8zEbVi0Efv04NRdxRqAo0Ro6a-lUm8_Okr6Qfaz8iWexogdpN3ryrTndKm44RWISmZhhQzk1xkaGP0DK9GhNG-xx_1l8BOqDekIJUu2IEyTjsDc Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Domain-Id: None Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Domain-Name: None Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Identity-Status: Confirmed Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Is-Admin-Project: True Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Domain-Id: default Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Domain-Name: Default Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Name: admin Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Role: member,admin,reader Oct 05 14:05:03.725204 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Roles: member,admin,reader Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_385992f3807a48ff8e105d88b2b7542e"}]}] Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant: admin Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant-Name: admin Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User: admin Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Domain-Id: default Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Domain-Name: Default Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Id: 1ee0b2255cbf41fe9a777949eff22087 Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Name: admin Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: method: > Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: exception: Flavor 84 could not be found. Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: action_args: {'id': '84'} Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:05:03.726798 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:03.727715 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.728946 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-ebd11595-beb7-4283-8002-678837d0a08f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:05:03.730070 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-ebd11595-beb7-4283-8002-678837d0a08f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393158 Oct 05 14:05:03.730070 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 14:05:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 14:05:03.736547 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b8f0d9c2-83ef-4747-83df-8d2c6aaf8f94 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:03.752068 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b8f0d9c2-83ef-4747-83df-8d2c6aaf8f94 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019147 Oct 05 14:05:03.752593 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 14:05:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:05:03.762400 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fa04ab5a-8373-421f-9c18-862b5b77de92 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:03.778289 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fa04ab5a-8373-421f-9c18-862b5b77de92 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019845 Oct 05 14:05:03.778824 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 14:05:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:05:03.788277 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b5a1c60d-a320-4dcc-88d3-b87654dc45ed admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:03.793291 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.wsgi [None req-b5a1c60d-a320-4dcc-88d3-b87654dc45ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b5a1c60d-a320-4dcc-88d3-b87654dc45ed admin admin] Request method failure captured: Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Accept: application/json Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Accept-Encoding: gzip, deflate Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Connection: keep-alive Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Content-Length: 0 Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Host: 10.222.0.16 Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Openstack-Api-Version: compute 2.92 Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Openstack-System-Scope: None Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: User-Agent: python-novaclient Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Auth-Token: gAAAAABjPY8PFD0YMCVWdf1-NoesykHOLbYnINmpPVMK6AHaZgUj6ObL8-PHyGO_Y-BhIpID8zEbVi0Efv04NRdxRqAo0Ro6a-lUm8_Okr6Qfaz8iWexogdpN3ryrTndKm44RWISmZhhQzk1xkaGP0DK9GhNG-xx_1l8BOqDekIJUu2IEyTjsDc Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Domain-Id: None Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Domain-Name: None Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Identity-Status: Confirmed Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Is-Admin-Project: True Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Domain-Id: default Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Domain-Name: Default Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Name: admin Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Role: member,admin,reader Oct 05 14:05:03.794786 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Roles: member,admin,reader Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_385992f3807a48ff8e105d88b2b7542e"}]}] Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant: admin Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant-Name: admin Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User: admin Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Domain-Id: default Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Domain-Name: Default Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Id: 1ee0b2255cbf41fe9a777949eff22087 Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Name: admin Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: method: > Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: exception: Flavor 84 could not be found. Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: action_args: {'id': '84'} Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:05:03.796402 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:03.797417 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:03.798825 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b5a1c60d-a320-4dcc-88d3-b87654dc45ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:05:03.800059 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b5a1c60d-a320-4dcc-88d3-b87654dc45ed admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011405 Oct 05 14:05:03.800059 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 14:05:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:05.003951 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fa04ab5a-8373-421f-9c18-862b5b77de92 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:05.004957 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fa04ab5a-8373-421f-9c18-862b5b77de92 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 05 14:05:05.005373 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:05.521926 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-e2df7364-0068-4c57-a6e2-33fd27f01c5b admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:05.527674 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.wsgi [None req-e2df7364-0068-4c57-a6e2-33fd27f01c5b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-e2df7364-0068-4c57-a6e2-33fd27f01c5b admin admin] Request method failure captured: Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Accept: application/json Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Accept-Encoding: gzip, deflate Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Connection: keep-alive Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Content-Length: 0 Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Host: 10.222.0.16 Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Openstack-Api-Version: compute 2.92 Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Openstack-System-Scope: None Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: User-Agent: python-novaclient Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Auth-Token: gAAAAABjPY8QnuuEzkIKiM5BRPbcxkZtXMOpI64ko6wdurUIbN9h58u-Z_TUk9ji145GHYmnJg_WPAq9e752NOs1MhmTDAuX_uk3sTdaH1HhOgXvTv8mitgkGApz4kLX0ZbeYrT-h6JTHElzbfroCtIx1ovaaT19KiRtrnGSli9X9AoR708rA5Y Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Domain-Id: None Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Domain-Name: None Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Identity-Status: Confirmed Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Is-Admin-Project: True Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Domain-Id: default Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Domain-Name: Default Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Project-Name: admin Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Role: member,admin,reader Oct 05 14:05:05.529181 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Roles: member,admin,reader Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_385992f3807a48ff8e105d88b2b7542e"}]}] Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant: admin Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-Tenant-Name: admin Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User: admin Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Domain-Id: default Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Domain-Name: Default Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Id: 1ee0b2255cbf41fe9a777949eff22087 Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: X-User-Name: admin Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: method: > Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: exception: Flavor 451 could not be found. Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: action_args: {'id': '451'} Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:05:05.530795 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:05.531687 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.532989 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-e2df7364-0068-4c57-a6e2-33fd27f01c5b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:05:05.534322 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-e2df7364-0068-4c57-a6e2-33fd27f01c5b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387407 Oct 05 14:05:05.534322 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 14:05:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:05.540326 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-6d98df17-7288-4e22-bcd7-44e66e200d0c admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:05.555022 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-6d98df17-7288-4e22-bcd7-44e66e200d0c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018294 Oct 05 14:05:05.555544 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 14:05:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:05:05.564961 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:05.579875 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018271 Oct 05 14:05:05.581089 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 14:05:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:05:05.589551 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b836b758-a36e-4c9b-95ce-f74a87eef4a7 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:05.594529 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.wsgi [None req-b836b758-a36e-4c9b-95ce-f74a87eef4a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b836b758-a36e-4c9b-95ce-f74a87eef4a7 admin admin] Request method failure captured: Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Accept: application/json Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Accept-Encoding: gzip, deflate Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Connection: keep-alive Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Content-Length: 0 Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Host: 10.222.0.16 Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Openstack-Api-Version: compute 2.92 Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Openstack-System-Scope: None Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: User-Agent: python-novaclient Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Auth-Token: gAAAAABjPY8QnuuEzkIKiM5BRPbcxkZtXMOpI64ko6wdurUIbN9h58u-Z_TUk9ji145GHYmnJg_WPAq9e752NOs1MhmTDAuX_uk3sTdaH1HhOgXvTv8mitgkGApz4kLX0ZbeYrT-h6JTHElzbfroCtIx1ovaaT19KiRtrnGSli9X9AoR708rA5Y Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Domain-Id: None Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Domain-Name: None Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Identity-Status: Confirmed Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Is-Admin-Project: True Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Domain-Id: default Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Domain-Name: Default Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Project-Name: admin Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Role: member,admin,reader Oct 05 14:05:05.596027 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Roles: member,admin,reader Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/385992f3807a48ff8e105d88b2b7542e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_385992f3807a48ff8e105d88b2b7542e"}]}] Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant: admin Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant-Id: 385992f3807a48ff8e105d88b2b7542e Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-Tenant-Name: admin Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User: admin Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Domain-Id: default Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Domain-Name: Default Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Id: 1ee0b2255cbf41fe9a777949eff22087 Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: X-User-Name: admin Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: method: > Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: exception: Flavor 451 could not be found. Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: action_args: {'id': '451'} Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:05:05.597659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:05.598469 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Oct 05 14:05:05.599635 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b836b758-a36e-4c9b-95ce-f74a87eef4a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:05:05.600647 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-b836b758-a36e-4c9b-95ce-f74a87eef4a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011345 Oct 05 14:05:05.600647 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 14:05:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 14:05:06.810421 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:06.811420 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 05 14:05:06.811801 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:07.328349 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-7ffc8170-586d-4197-9b6a-7d5862976b7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:05:07.348119 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-7ffc8170-586d-4197-9b6a-7d5862976b7c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398543 Oct 05 14:05:07.348659 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 14:05:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:05:08.561847 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:08.562855 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 05 14:05:08.563247 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:09.086523 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b33422ac-7f4b-430f-ad76-931dfb209e37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:05:09.104712 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-b33422ac-7f4b-430f-ad76-931dfb209e37 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403947 Oct 05 14:05:09.105307 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 14:05:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:05:10.317872 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:10.318996 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Oct 05 14:05:10.319487 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:10.834512 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1dc7a529-61e8-4bde-acfc-0d266a2f08e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:05:10.853122 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1dc7a529-61e8-4bde-acfc-0d266a2f08e2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398857 Oct 05 14:05:10.854202 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 14:05:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:05:12.060743 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:12.061835 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 05 14:05:12.062219 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:12.577029 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-62e2772a-5eab-4e34-a85a-dcd9cc52ce6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:05:12.597052 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-62e2772a-5eab-4e34-a85a-dcd9cc52ce6d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399986 Oct 05 14:05:12.597634 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 14:05:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:05:13.820579 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:13.821675 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 05 14:05:13.822064 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:05:14.334180 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-7b0daeee-54a9-4918-9b9f-e2940e51aca0 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:05:14.355249 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-7b0daeee-54a9-4918-9b9f-e2940e51aca0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397601 Oct 05 14:05:14.355854 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 5 14:05:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:06:10.698433 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:06:10.699400 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4bf30f68-d063-46d2-9035-58a673efa06e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 05 14:06:10.699802 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 14:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:06:10.710201 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:11.087708 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fcec63c4-583b-42a9-841f-4ba6e1713e92 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:06:11.108519 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fcec63c4-583b-42a9-841f-4ba6e1713e92 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402734 Oct 05 14:06:11.109067 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 14:06:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:06:11.129755 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=14 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:11.133749 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-858b92c7-884e-445c-8831-dfa53adc9e39 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:06:11.141440 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-858b92c7-884e-445c-8831-dfa53adc9e39 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013124 Oct 05 14:06:11.141950 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 5 14:06:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:06:11.153817 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-390afe4f-e103-4c13-87b0-e3376b31c10a admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:06:11.160917 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-390afe4f-e103-4c13-87b0-e3376b31c10a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011203 Oct 05 14:06:11.161484 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 5 14:06:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:06:11.172171 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:06:11.179160 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010389 Oct 05 14:06:11.179664 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 5 14:06:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:06:11.190358 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-315c3778-fa76-4c4b-9245-bec99b95b237 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:06:11.197717 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-315c3778-fa76-4c4b-9245-bec99b95b237 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010166 Oct 05 14:06:11.198215 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 5 14:06:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:09:16.160908 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:16.161974 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 05 14:09:16.162364 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:09:16.302664 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=6 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:16.459166 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:16.463861 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:16.464334 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:16.464761 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:16.465492 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:16.465938 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:16.466348 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:16.497528 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-e6191d6d-59a6-4701-b4e0-3b27345f6691 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.196111 Oct 05 14:09:16.498069 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 14:09:16 2022] GET /compute/v2.1/os-services => generated 785 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:09:17.574860 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:17.575926 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 05 14:09:17.576316 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:09:17.774654 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:17.778182 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:17.778661 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:17.779108 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:17.779824 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:17.780274 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:17.780691 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:17.799910 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-f62b7a42-742f-4e3f-bd13-7c544462f52e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.082420 Oct 05 14:09:17.800470 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 14:09:17 2022] GET /compute/v2.1/os-services => generated 785 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:09:29.281074 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:29.282103 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 05 14:09:29.282495 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:09:29.425328 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell0:SELECT=4 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:29.426046 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell1:SELECT=4 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:29.426656 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=8 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:29.473506 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:29.477486 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:29.477963 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:29.478387 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:29.479098 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:29.479920 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:29.479920 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:29.504977 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-5542ef24-ef4e-4ac4-8679-e27e9250ee5d admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.92 time: 0.083713 Oct 05 14:09:29.505360 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 14:09:29 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:09:30.580982 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:30.582014 dv-cinder-835878-4-smb devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-9bb71b67-e05c-480a-9362-9a082be676dd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 05 14:09:30.582413 dv-cinder-835878-4-smb devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 14:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:09:30.775845 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:09:30.779698 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:30.780175 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:30.780608 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:30.781407 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:09:30.781851 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:09:30.782277 dv-cinder-835878-4-smb devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:09:30.803838 dv-cinder-835878-4-smb devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-368f0cbe-e4cc-40f4-82c0-decb088f97b5 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.92 time: 0.080107 Oct 05 14:09:30.804337 dv-cinder-835878-4-smb devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 14:09:30 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:10:30.203759 dv-cinder-835878-4-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 05 14:10:30.204324 dv-cinder-835878-4-smb devstack@n-api.service[105596]: Wed Oct 5 14:10:30 2022 - graceful shutdown triggered... Oct 05 14:10:30.204789 dv-cinder-835878-4-smb devstack@n-api.service[105597]: Gracefully killing worker 1 (pid: 105597)... Oct 05 14:10:30.205825 dv-cinder-835878-4-smb devstack@n-api.service[105598]: Gracefully killing worker 2 (pid: 105598)... Oct 05 14:10:30.332018 dv-cinder-835878-4-smb devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=4 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:10:31.204993 dv-cinder-835878-4-smb devstack@n-api.service[105596]: worker 1 buried after 1 seconds Oct 05 14:10:31.204993 dv-cinder-835878-4-smb devstack@n-api.service[105596]: worker 2 buried after 1 seconds Oct 05 14:10:31.204993 dv-cinder-835878-4-smb devstack@n-api.service[105596]: goodbye to uWSGI. Oct 05 14:10:31.206602 dv-cinder-835878-4-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 05 14:10:31.207151 dv-cinder-835878-4-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 05 14:10:31.209825 dv-cinder-835878-4-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 14:10:31.221606 dv-cinder-835878-4-smb devstack@n-api.service[120624]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 14:10:31 2022] *** Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: nodename: dv-cinder-835878-4-smb Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: machine: x86_64 Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: clock source: unix Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: pcre jit disabled Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: detected number of CPU cores: 4 Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: current working directory: / Oct 05 14:10:31.223619 dv-cinder-835878-4-smb devstack@n-api.service[120624]: detected binary path: /usr/bin/uwsgi-core Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: your processes number limit is 47680 Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: your memory page size is 4096 bytes Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: detected max file descriptor number: 2048 Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: lock engine: pthread robust mutexes Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: thunder lock: enabled Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 14:10:31.224268 dv-cinder-835878-4-smb devstack@n-api.service[120624]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 14:10:31.265279 dv-cinder-835878-4-smb devstack@n-api.service[120624]: Python main interpreter initialized at 0x5611fea069c0 Oct 05 14:10:31.265279 dv-cinder-835878-4-smb devstack@n-api.service[120624]: python threads support enabled Oct 05 14:10:31.265279 dv-cinder-835878-4-smb devstack@n-api.service[120624]: your server socket listen backlog is limited to 100 connections Oct 05 14:10:31.265279 dv-cinder-835878-4-smb devstack@n-api.service[120624]: your mercy for graceful operations on workers is 90 seconds Oct 05 14:10:31.265738 dv-cinder-835878-4-smb devstack@n-api.service[120624]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 14:10:31.265738 dv-cinder-835878-4-smb devstack@n-api.service[120624]: *** Operational MODE: preforking *** Oct 05 14:10:31.266001 dv-cinder-835878-4-smb devstack@n-api.service[120624]: *** uWSGI is running in multiple interpreter mode *** Oct 05 14:10:31.266001 dv-cinder-835878-4-smb devstack@n-api.service[120624]: spawned uWSGI master process (pid: 120624) Oct 05 14:10:31.266212 dv-cinder-835878-4-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 05 14:10:31.269266 dv-cinder-835878-4-smb devstack@n-api.service[120624]: spawned uWSGI worker 1 (pid: 120645, cores: 1) Oct 05 14:10:31.269266 dv-cinder-835878-4-smb devstack@n-api.service[120624]: spawned uWSGI worker 2 (pid: 120646, cores: 1) Oct 05 14:10:31.269266 dv-cinder-835878-4-smb devstack@n-api.service[120624]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 14:10:31.926542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 14:10:31.929008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 14:10:33.093532 dv-cinder-835878-4-smb devstack@n-api.service[120646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:10:33.093532 dv-cinder-835878-4-smb devstack@n-api.service[120646]: from cryptography.utils import int_from_bytes Oct 05 14:10:33.094159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:10:33.094159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: from cryptography.utils import int_from_bytes Oct 05 14:10:33.095386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:10:33.095386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: from cryptography.utils import int_from_bytes Oct 05 14:10:33.095875 dv-cinder-835878-4-smb devstack@n-api.service[120645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 14:10:33.095875 dv-cinder-835878-4-smb devstack@n-api.service[120645]: from cryptography.utils import int_from_bytes Oct 05 14:10:35.526861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 14:10:35.527452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 14:10:35.527679 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 14:10:35.528057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 14:10:35.528319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 14:10:35.528720 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.529057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.529431 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.529760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.530105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.530417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.530748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.531075 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.531413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.531679 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.532000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.532505 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-4-smb {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.532839 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.533161 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.533506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.533843 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.534155 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.534490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.534806 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.535432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.537426 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.537931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.538271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.538641 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.538977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.539303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.539643 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.539968 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.540336 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.540646 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.541069 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-4-smb {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.541421 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.542286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.542622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.543056 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.543382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.543704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.544037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.544370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.544691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.545044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.545402 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.545734 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.546068 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.546377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.548800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.549647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.549647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.549896 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.550127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.550403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.550719 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.551064 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.551368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.551685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.551999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.552313 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.552627 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.552939 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.553287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.553605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.553931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.554258 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.554591 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.554903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.555230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.555649 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.555910 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.556222 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.556579 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.556903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.557846 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.558201 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.558537 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.558858 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.559178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.559495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.559824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.560173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.560491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.560752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.561067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.561404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.561732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.562049 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.562364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.562680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.562988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.563305 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.563619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.563931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.564242 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.564556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.564880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.565182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.565520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.565837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.566148 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.566473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.566799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.567113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.567424 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.567733 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.568052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.568378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.568691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.569001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.569351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.569667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.569979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.570303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.570922 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.571394 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 14:10:35.571833 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.571916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 14:10:35.571991 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.572075 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.572185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 14:10:35.572354 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.572549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 14:10:35.572682 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.572836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 14:10:35.573027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.573264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.573363 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.573588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.573695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.573916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574005 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574374 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574642 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.574952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.575183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.575263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.575491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.575588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.575848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.575952 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.576083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.576182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.576404 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.576506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.576746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.576872 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-4-smb {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.577106 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.577201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.577404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.577503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.577753 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.577863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.578108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.578220 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.578418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.578514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.578747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.578851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.579054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.579147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.579406 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.579574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.579732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.579890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.580050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.580201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.580370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.580516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.580727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.580858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.581025 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.581173 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.581430 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.581548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.581686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.581824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.582012 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.582125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.582349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.582469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.582672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.582773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.583000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.583143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-4-smb {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.583326 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.583465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.583652 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.583782 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.583973 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.584101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.584302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.584517 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.584639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.584832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.584969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.585146 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.585332 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.585498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.585649 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.585859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.586004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.586132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.586324 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.586561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.586665 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.586794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.586979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.587240 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.587353 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.587446 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.587606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.587727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.587930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.588044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.588281 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.588405 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.588625 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.588918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.589033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.589251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.589359 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.589571 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.589670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.589827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.589929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.590141 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.590244 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.590465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.590565 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.590788 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.590893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.591118 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.591219 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.591374 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.591466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.591700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.591807 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.591948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.592074 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.592273 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.592499 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.592658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.592747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.592883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.593020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.593195 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.593372 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.593530 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.593691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.593841 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.594011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.594152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.594330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.594475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.594642 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.594741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.594956 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.595048 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.595269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.595363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.595588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.595686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.595974 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.596078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.596227 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.596327 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.596673 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.596780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.596867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.596947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.597202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.597499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.597592 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.597679 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.597859 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.597953 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.598177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.598258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.598496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.598578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.598812 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.598921 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.599126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.599224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.599436 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.599518 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.599748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.599841 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.600071 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.600152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.600389 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.600475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.600701 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.600791 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.600955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.601035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.601538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.601704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.601981 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.602182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.602344 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.602645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.602812 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.602970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.603124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.603291 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.603459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.603609 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.603755 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.603909 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.604731 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.604903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.605060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.605218 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.605443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.605599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.605747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.605903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.606079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.606308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.606472 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.606621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.606930 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.607100 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.607249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.607561 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.607722 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.607878 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.608028 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.608207 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.608476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.608653 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.608805 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.608959 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.609137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.609396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.609562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.609711 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.609867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.610016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.610170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.610318 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.610472 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.610639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.610796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.610958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.611122 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.611277 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.611432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.611588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.611736 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.611882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.612129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.612284 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.612439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.612715 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.612882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.613037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.613186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.613367 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.613527 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.613676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.613837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.613990 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.614136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.614283 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.614442 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.614442 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.614826 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.614997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.615153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.615301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.615460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.615608 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.615761 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.615916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.616071 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.616226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.616738 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.617060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.617255 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.617424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.617742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.617907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.618436 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.618618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.618770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.618916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.619061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.619220 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.619386 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.620253 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.620425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.620580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.620738 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.620894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 14:10:35.621043 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.621188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.621388 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.621549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.621707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.622815 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.623685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.624623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.624914 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.625086 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.625298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.625468 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.625624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.625780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.625928 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.626084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.626233 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.626386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.626629 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.626786 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.626933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.627243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.627408 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.627557 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.627868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.628027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.628176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.628895 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.629055 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.629212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.629435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.629610 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.629836 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.630939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631242 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631389 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631690 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.631995 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.632159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.632315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.632463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.632723 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.632969 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.633127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.633582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.633835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.634005 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.634177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.634326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.634472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.634638 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.634799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.635064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.635230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.635409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.635567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.635714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.635867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.636023 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.636171 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.636966 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.637156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.637489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.637652 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.637800 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.638326 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.638487 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.638645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.638977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.639143 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.639300 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.639452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.639613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.639762 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.640114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.640293 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.640446 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.640593 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.640754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.640904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641050 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641203 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641390 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641555 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.641861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.642159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.642159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.642460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.642609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.642872 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.642872 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.643275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.643427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.643588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.643745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.643918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.643918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.644331 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.644493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.644651 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.644845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.645136 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.645338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.645492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.645639 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.645798 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.645947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.646094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.646239 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.646385 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.646540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.646708 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.646856 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.647105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.647265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.647590 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.647764 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.647924 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.648274 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.648435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.648583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.648729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.648923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650284 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650803 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.650998 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651073 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651155 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651405 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651550 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651786 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.651936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652238 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652318 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652636 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652709 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652788 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652861 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.652943 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653099 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653291 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653377 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.653978 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654057 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654216 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654296 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654597 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654826 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654911 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.654991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655065 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655150 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655305 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655446 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655525 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655774 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655846 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.655989 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656507 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656590 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656743 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656817 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.656970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657132 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657544 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.657708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658265 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658367 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658463 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658666 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658755 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.658934 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659597 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.659931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660088 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660170 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660571 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.660987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661070 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.661956 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662213 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662297 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662571 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662651 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662733 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.662968 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663039 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663216 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663663 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663841 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.663937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664375 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664591 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.664940 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.665173 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.665348 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.665551 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.665650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.665870 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.665962 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.666147 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.666251 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.666454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.667106 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.667470 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.667659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.667820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.667982 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.668131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.668286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.668524 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.668763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.669017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.669191 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.669566 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.669732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.669883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.670940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.671133 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.671284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.671438 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.671585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.671732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.671880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672039 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672513 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.672825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.673107 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.673272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.673438 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.673594 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.673751 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.673900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674086 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674380 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674822 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.674916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.675017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.675110 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.675252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.675337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.675575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.675722 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676087 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676679 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676845 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.676988 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.677128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.677274 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.677632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.677770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.677867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.677971 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.678204 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.678519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.678625 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.678720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.678828 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.678914 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.679347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.679447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.679569 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.679657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.679744 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.683429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684483 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684591 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.684971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.685054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.685595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.685682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.685682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.685682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687099 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687350 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687444 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687643 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687741 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687834 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.687913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688466 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688555 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688740 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.688917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690546 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690627 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690777 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690855 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.690997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.691080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.691167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.691250 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.691250 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.691250 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693426 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693517 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693692 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693854 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.693930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694077 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694238 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694321 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694539 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694695 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694861 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.694936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695281 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695518 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.695972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.696044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.696145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.696231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.696321 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.697895 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698180 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698324 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.698934 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699103 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699184 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699264 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699337 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699409 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.699512 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700743 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700826 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.700990 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.701063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.701149 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.701247 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.701339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.701431 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.701941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702046 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702769 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.702845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703341 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703810 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.703970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.704128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.704288 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.704447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.704646 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.704812 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.704975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.705135 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.705308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.705466 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.705617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.705789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.705952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.706105 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.706105 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.706401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.706560 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.706723 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.707137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.707302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.707461 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.707615 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.707767 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.707927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708029 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708104 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708246 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708341 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708438 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708673 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.708943 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.709218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.709563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.709563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.709749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.709847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.709922 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.710400 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.710525 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.710621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.710709 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.710790 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.710863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.711126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.711231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.711460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.711559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.711787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.711893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.712088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.712296 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.712455 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.712554 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.712768 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.712873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.713110 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.713324 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.713457 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.713548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.713802 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.713907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.714156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.714330 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.714425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.714514 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.714737 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.714971 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715073 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715857 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.715956 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.716145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.716256 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.716460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.716564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.716777 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.716882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.717333 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.717440 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.717581 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.717672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.717748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.717827 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.718075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.718231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.718386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.718560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.718689 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.718779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.719013 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.719123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.719322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.719425 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.719655 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.719874 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.720013 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.720121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.720315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.720481 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.720706 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.720869 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.721021 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.721184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.721409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.721563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.721727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.721889 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722042 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722150 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722328 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722736 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.722849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723033 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723344 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723448 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723660 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.723975 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.724070 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.724286 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.724382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.724618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.724892 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.724995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.725316 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.725494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.725602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.725821 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.725917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.726144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.726252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.726467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.726572 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.726789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.726932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.727130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.727240 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.727444 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.727567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.727762 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.727858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.728081 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.728176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.728407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.728512 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.728726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.728819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.729649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.729765 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.729921 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.730024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.730289 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.730422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.730651 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.730832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.730975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.731130 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.731228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.731453 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.731550 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.731765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.731875 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.732082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.732193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.732392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.732482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.732725 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.732830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.733036 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.733167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.733422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.733532 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.733736 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.733834 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734362 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734679 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734775 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.734999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.735093 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.735345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.735455 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.735667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.735771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.735987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.736115 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.736320 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.736433 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.736663 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.736757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.736993 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.737094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.737380 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.737604 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.737705 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.737799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.737969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.738129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.738357 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.738520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.738625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.738824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.738934 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.739162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.739265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.739494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.739595 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.739824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.739924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.740164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.740268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.740476 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.740564 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.740801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.740911 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.741113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.741248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.741486 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.741612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.741764 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.741900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.742083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.742231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.742539 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.742684 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.742783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.742882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.743275 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.743435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.743592 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.743748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.743918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.744058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.744234 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.744375 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.744734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.745396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.745572 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.745697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.745901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.746027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.746210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.746361 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.746526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.746698 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.746847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747225 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747327 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747662 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.747942 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.748177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.748287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.748482 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.748589 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.748807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.748910 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.749130 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.749282 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.749483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.749596 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.749801 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.749901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.750107 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.750201 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.750414 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.750522 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.750731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.750940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751043 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751756 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.751957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.752051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.752270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.752366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.752589 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.752684 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.752901 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753010 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753541 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753854 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.753958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.754174 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.754270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.754485 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.754579 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.754818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.754935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.755140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.755233 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.755469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.755564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.755776 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.755880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756703 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756827 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.756999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.757095 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.757337 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.757438 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.757671 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.757779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.757943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758359 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758658 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.758986 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.759191 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.759292 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.759516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.759613 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.759830 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.760114 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.760216 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.760460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.760566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.760769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.760871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.761116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.761217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.761453 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.761550 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.761779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.761870 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.762093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.762188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.762420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.762525 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.762724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.762818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.763991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.764085 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.764309 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.764413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.764627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.764717 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.764954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.765285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.765608 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.765725 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.766583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.766699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.766699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.766885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.766982 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.767066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.767140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.767235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.767745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.767859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.767859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.768001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.768101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.768382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.768477 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.768683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.768768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769120 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769637 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769801 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.769875 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.770220 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.770313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.770503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.770594 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.771979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.772085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.772238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773592 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773685 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773772 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.773954 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774207 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774308 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774394 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774733 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.774876 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.775029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.775184 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.775432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.775609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.775749 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.775910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.776048 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.776198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.776520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.776611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.776697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.776782 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.777534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.777647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.777647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.777822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.777940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.778035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.778132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.779562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.779683 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.779683 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.779844 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.779929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780373 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780652 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780745 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.780924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.781022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.781109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782412 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782539 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782806 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.782961 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783195 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783682 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783774 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.783920 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.784115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.784210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.784336 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.784585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.784685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.784945 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.785991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.786201 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.786304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.786519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.786612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.786828 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.786935 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.787152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.787267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.787459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.787554 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.787780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.787990 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.788093 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.788337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.788431 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.788681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.788780 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.789458 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.789562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.789673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.789768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.789860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.789951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.790037 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.790131 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.790224 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.790760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.790873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.790970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.791071 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.791158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792527 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.792890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793034 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793288 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793495 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793813 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.793918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.794122 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.794233 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.794524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.794627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.794836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.794930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.795152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.795258 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.795498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.795603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.795816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.795919 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.796124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.796218 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.796451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.796547 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.796760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.796864 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.797068 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.797175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.797416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.797514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.797732 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.797828 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.798063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.798178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.798380 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.798484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.798699 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.799151 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.799330 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.799486 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.799636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.799786 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.799786 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.800113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.800279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.800502 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.800658 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.800807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.800965 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.801125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.801309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.801466 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.801615 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.801772 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.801937 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.802099 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.802358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.802519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.802767 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.802925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.803089 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.803246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.803401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.803557 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.803706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.803853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.804010 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.804159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.804341 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 14:10:35.804623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.804623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.804623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.805063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.805217 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.805446 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.805762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.806080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.806394 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.806707 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.807026 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.807932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.808258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.808577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.808898 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.809212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.809553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.809864 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.810178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.810489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.810808 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.811140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.811458 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.811770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.812585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.812585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.812831 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.813155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.813516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.813847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.814176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.814494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.814823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.815140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.815476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.815824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.816156 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.816483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.816795 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.817104 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.817438 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.817753 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.818075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.818386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.818694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.819002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.819314 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.819625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.819933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.820241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.820545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.820857 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.821160 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.821510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.821817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.822123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.822428 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.822734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.823110 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.823399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.823708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.824011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.824317 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.824623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.824958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.825317 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.825637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.825966 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.826277 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.826602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.826915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.827241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.827581 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.827885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.828201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.828535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.828849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.829163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.829529 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.829847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.830164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.830478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.830810 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.831140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.831449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.831778 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.832100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.832426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.832747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.833060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.833419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.833736 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.834052 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.834368 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.834996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.835316 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.835637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.836014 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.836263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.836582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.836913 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.837266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.837583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.837913 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.838243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.839119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.839433 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.839783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.840121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.840439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.840755 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.841064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 14:10:35.841332 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 14:10:35.866296 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO dbcounter [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Registered counter for database nova_api Oct 05 14:10:35.886778 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_db.sqlalchemy.engines [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:35.893551 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writer thread running {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:35.903160 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO dbcounter [None req-1d56073e-127e-4820-8035-edae2403831b None None] Registered counter for database nova_api Oct 05 14:10:35.923737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_db.sqlalchemy.engines [None req-1d56073e-127e-4820-8035-edae2403831b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:35.930475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writer thread running {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:35.949931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.context [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab08cad5-af0f-42a8-b6cc-999af6152333(cell1) {{(pid=120646) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 14:10:35.954006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:10:35.954494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:10:35.956080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:10:35.956815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:10:35.957298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:10:35.959306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:10:35.961323 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO dbcounter [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Registered counter for database nova_cell0 Oct 05 14:10:35.965876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO dbcounter [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Registered counter for database nova_cell1 Oct 05 14:10:35.972930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_db.sqlalchemy.engines [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:35.975189 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_db.sqlalchemy.engines [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:35.981356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writer thread running {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:35.983429 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writer thread running {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:35.986294 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.context [None req-1d56073e-127e-4820-8035-edae2403831b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab08cad5-af0f-42a8-b6cc-999af6152333(cell1) {{(pid=120645) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 14:10:35.990355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d56073e-127e-4820-8035-edae2403831b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:10:35.990842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d56073e-127e-4820-8035-edae2403831b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:10:35.992418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d56073e-127e-4820-8035-edae2403831b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:10:35.993436 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d56073e-127e-4820-8035-edae2403831b None None] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:10:35.993896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d56073e-127e-4820-8035-edae2403831b None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:10:35.995915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d56073e-127e-4820-8035-edae2403831b None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:10:35.997929 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO dbcounter [None req-1d56073e-127e-4820-8035-edae2403831b None None] Registered counter for database nova_cell0 Oct 05 14:10:36.001938 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO dbcounter [None req-1d56073e-127e-4820-8035-edae2403831b None None] Registered counter for database nova_cell1 Oct 05 14:10:36.009002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_db.sqlalchemy.engines [None req-1d56073e-127e-4820-8035-edae2403831b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:36.011268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_db.sqlalchemy.engines [None req-1d56073e-127e-4820-8035-edae2403831b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:36.015896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writer thread running {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:36.019066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writer thread running {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:36.134712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO dbcounter [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Registered counter for database nova_cell0 Oct 05 14:10:36.141466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_db.sqlalchemy.engines [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:36.146117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writer thread running {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:36.169511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO dbcounter [None req-1d56073e-127e-4820-8035-edae2403831b None None] Registered counter for database nova_cell0 Oct 05 14:10:36.176629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_db.sqlalchemy.engines [None req-1d56073e-127e-4820-8035-edae2403831b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 14:10:36.181062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writer thread running {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 14:10:36.474080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: WARNING keystonemiddleware.auth_token [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:10:36.481496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: WARNING keystonemiddleware.auth_token [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:10:36.501651 dv-cinder-835878-4-smb devstack@n-api.service[120645]: WARNING keystonemiddleware.auth_token [None req-1d56073e-127e-4820-8035-edae2403831b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:10:36.508937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: WARNING keystonemiddleware.auth_token [None req-1d56073e-127e-4820-8035-edae2403831b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:10:36.828719 dv-cinder-835878-4-smb devstack@n-api.service[120646]: WARNING keystonemiddleware.auth_token [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:10:36.835341 dv-cinder-835878-4-smb devstack@n-api.service[120646]: WARNING keystonemiddleware.auth_token [None req-b0868522-ffb8-4172-b2b6-3fa20d24a4fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:10:36.840836 dv-cinder-835878-4-smb devstack@n-api.service[120646]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611fea069c0 pid: 120646 (default app) Oct 05 14:10:36.855784 dv-cinder-835878-4-smb devstack@n-api.service[120645]: WARNING keystonemiddleware.auth_token [None req-1d56073e-127e-4820-8035-edae2403831b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 14:10:36.861814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: WARNING keystonemiddleware.auth_token [None req-1d56073e-127e-4820-8035-edae2403831b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 14:10:36.867110 dv-cinder-835878-4-smb devstack@n-api.service[120645]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611fea069c0 pid: 120645 (default app) Oct 05 14:11:12.865209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.867742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.871447 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.872237 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:15.083533 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8436e797-c88d-4318-b029-378dde4905e9 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Action: 'create', calling method: .version_select at 0x7f218e1af4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-25546792"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:17.359494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8436e797-c88d-4318-b029-378dde4905e9 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.510667 Oct 05 14:11:17.360690 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Oct 5 14:11:12 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4514 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 14:11:17.379916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:17.381032 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:17.383879 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:17.385274 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:17.567113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b4d47d9f-0e3b-4821-bb5a-8b726ab20439 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218e0833a0>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:17.771749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3c59f32a-f204-4d1c-bf1d-4bbdce637a8a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e1f8160>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:17.855503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b4d47d9f-0e3b-4821-bb5a-8b726ab20439 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2f58eabb-ab67-4059-b8b8-1fe492f92e57" status: 200 len: 351 microversion: 2.1 time: 0.292948 Oct 05 14:11:17.856073 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:17 2022] GET /compute/v2.1/os-volumes/2f58eabb-ab67-4059-b8b8-1fe492f92e57 => generated 351 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:18.330067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3c59f32a-f204-4d1c-bf1d-4bbdce637a8a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034" status: 200 len: 344 microversion: 2.1 time: 0.956038 Oct 05 14:11:18.331046 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:17 2022] GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 => generated 344 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:18.346160 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-580fd6bf-18a7-489a-9c0c-a801286c899a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Action: 'create', calling method: .version_select at 0x7f218e083a60>, body: {"snapshot": {"volume_id": "0aa3b208-6633-4d11-8e37-97671f741034", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1350745855"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:18.834249 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-580fd6bf-18a7-489a-9c0c-a801286c899a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.492811 Oct 05 14:11:18.841425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 3/4] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 5 14:11:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:18.849976 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8ec4eeae-4a95-43f6-97c8-f1089c661c41 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e0bf3a0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:19.212293 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8ec4eeae-4a95-43f6-97c8-f1089c661c41 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850" status: 200 len: 288 microversion: 2.1 time: 0.369407 Oct 05 14:11:19.212856 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 14:11:18 2022] GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850 => generated 288 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:19.224255 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8428884e-1a54-4e9e-ba15-7fe67adea713 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e017c10>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:19.560267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8428884e-1a54-4e9e-ba15-7fe67adea713 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 291 microversion: 2.1 time: 0.339661 Oct 05 14:11:19.563390 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 4/6] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 14:11:19 2022] GET /compute/v2.1/os-snapshots => generated 291 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:19.596688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9f7959df-e222-43a3-8d61-58c9e7c6ba97 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e0bfaf0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:19.688066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9f7959df-e222-43a3-8d61-58c9e7c6ba97 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850" status: 200 len: 288 microversion: 2.1 time: 0.113973 Oct 05 14:11:19.689056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 14:11:19 2022] GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850 => generated 288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:19.701795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8ea4ac10-ca13-409c-bbd0-cd3cef3b60a8 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e1afee0>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:20.093753 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8ea4ac10-ca13-409c-bbd0-cd3cef3b60a8 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850" status: 202 len: 0 microversion: 2.1 time: 0.397100 Oct 05 14:11:20.095347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 14:11:19 2022] DELETE /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:11:20.103811 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9f5d40ca-78f6-4f9d-aebe-5a83324aa903 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e0bfca0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:20.289403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0d5bf14a-c6ce-44f6-ab1b-3fdc9fe249ac tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218e0839d0>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:20.370796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9f5d40ca-78f6-4f9d-aebe-5a83324aa903 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850" status: 200 len: 287 microversion: 2.1 time: 0.271268 Oct 05 14:11:20.372657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 14:11:20 2022] GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850 => generated 287 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:20.496959 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0d5bf14a-c6ce-44f6-ab1b-3fdc9fe249ac tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f1773b4-317d-4342-a44e-3797d677a855" status: 200 len: 350 microversion: 2.1 time: 0.210887 Oct 05 14:11:20.498311 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:20 2022] GET /compute/v2.1/os-volumes/0f1773b4-317d-4342-a44e-3797d677a855 => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:21.385539 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-56042a1f-bb9f-4a37-9f74-471a56f7c32a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e0bf430>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:21.434362 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-56042a1f-bb9f-4a37-9f74-471a56f7c32a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] HTTP exception thrown: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-56042a1f-bb9f-4a37-9f74-471a56f7c32a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Request method failure captured: Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850 HTTP/1.1 Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCAuNDTGJGnzQcnh8XH2JR1w3AmqcpKvzvhUH_JlnLcC9USygH-NYdDi1JSfuzg3kg4q15_WMTWEQbvdeOW2gDChuZrmKcqJD36fe74jal_AO1iNtptjGu2KXp46YF5G1iFq_jm44IPn2tG9nIU0wrJ1kjqkeECexobAXn58IJlTpw Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:11:21.440030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089a805e7e6346dd8481b683a4060c44"}]}] Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 3011b7cd55e64fcab9ceb114658e1f8f Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': 'cb860d06-829f-4ec9-9414-cb7dc1fd1850'} Oct 05 14:11:21.441064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. (HTTP 404) (Request-ID: req-74fe6e11-e1c6-4f9a-985b-15bde0133f6a) Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.441717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:21.442536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 05 14:11:21.443445 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. Oct 05 14:11:21.447226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:21.450281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-56042a1f-bb9f-4a37-9f74-471a56f7c32a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Returning 404 to user: Snapshot cb860d06-829f-4ec9-9414-cb7dc1fd1850 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:21.456562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-56042a1f-bb9f-4a37-9f74-471a56f7c32a tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850" status: 404 len: 111 microversion: 2.1 time: 0.073834 Oct 05 14:11:21.458687 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 14:11:21 2022] GET /compute/v2.1/os-snapshots/cb860d06-829f-4ec9-9414-cb7dc1fd1850 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:11:21.467423 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-30d86353-2a43-4a75-b1af-44d61ca478d6 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e083160>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:21.694616 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-30d86353-2a43-4a75-b1af-44d61ca478d6 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034" status: 202 len: 0 microversion: 2.1 time: 0.232479 Oct 05 14:11:21.695712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:11:21 2022] DELETE /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:11:21.708296 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f45ec96d-5a94-4fa1-a88a-41c292a5e45b tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e089ca0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:21.920879 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f45ec96d-5a94-4fa1-a88a-41c292a5e45b tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034" status: 200 len: 343 microversion: 2.1 time: 0.219900 Oct 05 14:11:21.921772 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:21 2022] GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:22.357163 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-16798a04-ff33-444f-bda2-dcdd4a02d0d1 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218e083c10>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:22.612339 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-16798a04-ff33-444f-bda2-dcdd4a02d0d1 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6a8c6848-cd92-4557-80be-d936aa74af66" status: 200 len: 351 microversion: 2.1 time: 0.259668 Oct 05 14:11:22.613185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:22 2022] GET /compute/v2.1/os-volumes/6a8c6848-cd92-4557-80be-d936aa74af66 => generated 351 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:22.631161 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6f434d8f-cb6a-487a-a9bd-882d0a5bfd8e tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218dfe0310>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:22.939298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1d4b44c7-fbcc-46f9-a5b0-45f2c102a1f0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e9dd940>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:23.067683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6f434d8f-cb6a-487a-a9bd-882d0a5bfd8e tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.441335 Oct 05 14:11:23.079731 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 14:11:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:23.096095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d2d97fa6-d237-40ec-8e44-9e36abf89c32 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218e089af0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-1d4b44c7-fbcc-46f9-a5b0-45f2c102a1f0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] HTTP exception thrown: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1d4b44c7-fbcc-46f9-a5b0-45f2c102a1f0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Request method failure captured: Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 HTTP/1.1 Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCAuNDTGJGnzQcnh8XH2JR1w3AmqcpKvzvhUH_JlnLcC9USygH-NYdDi1JSfuzg3kg4q15_WMTWEQbvdeOW2gDChuZrmKcqJD36fe74jal_AO1iNtptjGu2KXp46YF5G1iFq_jm44IPn2tG9nIU0wrJ1kjqkeECexobAXn58IJlTpw Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:23.214184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089a805e7e6346dd8481b683a4060c44"}]}] Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 3011b7cd55e64fcab9ceb114658e1f8f Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '0aa3b208-6633-4d11-8e37-97671f741034'} Oct 05 14:11:23.215513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. (HTTP 404) (Request-ID: req-78b108ec-e24e-4a34-9c12-ab30bda94e0c) Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.216217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:23.217254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 14:11:23.218187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1d4b44c7-fbcc-46f9-a5b0-45f2c102a1f0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Returning 404 to user: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1d4b44c7-fbcc-46f9-a5b0-45f2c102a1f0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034" status: 404 len: 109 microversion: 2.1 time: 0.280880 Oct 05 14:11:23.219153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:22 2022] GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 => generated 109 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 14:11:23.239651 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-017cc08b-e980-4177-8308-8fdab99efd6e tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218e017d30>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:23.358495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-017cc08b-e980-4177-8308-8fdab99efd6e tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] HTTP exception thrown: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-017cc08b-e980-4177-8308-8fdab99efd6e tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Request method failure captured: Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 HTTP/1.1 Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCAuNDTGJGnzQcnh8XH2JR1w3AmqcpKvzvhUH_JlnLcC9USygH-NYdDi1JSfuzg3kg4q15_WMTWEQbvdeOW2gDChuZrmKcqJD36fe74jal_AO1iNtptjGu2KXp46YF5G1iFq_jm44IPn2tG9nIU0wrJ1kjqkeECexobAXn58IJlTpw Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:23.360669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089a805e7e6346dd8481b683a4060c44"}]}] Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 3011b7cd55e64fcab9ceb114658e1f8f Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '0aa3b208-6633-4d11-8e37-97671f741034'} Oct 05 14:11:23.361893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. (HTTP 404) (Request-ID: req-e9ae63fd-4e4e-4817-803f-bc95fd649ac1) Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.362562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 14:11:23.363422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 14:11:23.364276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.365379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.367366 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-017cc08b-e980-4177-8308-8fdab99efd6e tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Returning 404 to user: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:23.369111 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-017cc08b-e980-4177-8308-8fdab99efd6e tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034" status: 404 len: 109 microversion: 2.1 time: 0.145574 Oct 05 14:11:23.370075 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 10/17] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:11:23 2022] DELETE /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:11:23.549032 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d2d97fa6-d237-40ec-8e44-9e36abf89c32 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.456814 Oct 05 14:11:23.550258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 8/18] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 14:11:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:23.555354 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f6990b3f-b990-49ce-b7d3-a8bc40d88dc0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Calling method '.version_select at 0x7f218dfe7ee0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:23.634067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-f6990b3f-b990-49ce-b7d3-a8bc40d88dc0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] HTTP exception thrown: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f6990b3f-b990-49ce-b7d3-a8bc40d88dc0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Request method failure captured: Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 HTTP/1.1 Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCAuNDTGJGnzQcnh8XH2JR1w3AmqcpKvzvhUH_JlnLcC9USygH-NYdDi1JSfuzg3kg4q15_WMTWEQbvdeOW2gDChuZrmKcqJD36fe74jal_AO1iNtptjGu2KXp46YF5G1iFq_jm44IPn2tG9nIU0wrJ1kjqkeECexobAXn58IJlTpw Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:11:23.638630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089a805e7e6346dd8481b683a4060c44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089a805e7e6346dd8481b683a4060c44"}]}] Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 089a805e7e6346dd8481b683a4060c44 Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1591890895 Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 3011b7cd55e64fcab9ceb114658e1f8f Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1591890895-project Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '0aa3b208-6633-4d11-8e37-97671f741034'} Oct 05 14:11:23.639839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. (HTTP 404) (Request-ID: req-75a0e1c7-2144-4a94-baff-3fff5ef69b60) Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.640609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:23.641746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 14:11:23.642852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. Oct 05 14:11:23.643942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:11:23.645413 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f6990b3f-b990-49ce-b7d3-a8bc40d88dc0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] Returning 404 to user: Volume 0aa3b208-6633-4d11-8e37-97671f741034 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:23.646895 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f6990b3f-b990-49ce-b7d3-a8bc40d88dc0 tempest-VolumesSnapshotsTestJSON-1591890895 tempest-VolumesSnapshotsTestJSON-1591890895-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034" status: 404 len: 109 microversion: 2.1 time: 0.095482 Oct 05 14:11:23.647624 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 9/19] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:23 2022] GET /compute/v2.1/os-volumes/0aa3b208-6633-4d11-8e37-97671f741034 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:11:23.668667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-781888d8-f032-48b6-baae-d35986c20947 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218dfe75e0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:23.969352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-781888d8-f032-48b6-baae-d35986c20947 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.316814 Oct 05 14:11:23.969928 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 10/20] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 14:11:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:23.984089 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2a0600dd-60c2-4d9b-8b4a-87bf6d35f39d tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218dfe04c0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:24.228574 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-925567226", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "networks": [{"uuid": "f92fc986-c514-4a66-a26e-aca0db0e63f4"}]}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:24.305151 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2a0600dd-60c2-4d9b-8b4a-87bf6d35f39d tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.324850 Oct 05 14:11:24.306166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 14:11:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:24.320429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1f19c5bb-c671-4708-9517-a18a2bd99f2a tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218dfe79d0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:24.434109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] validate_networks() for [('f92fc986-c514-4a66-a26e-aca0db0e63f4', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:11:24.681307 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1f19c5bb-c671-4708-9517-a18a2bd99f2a tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.365184 Oct 05 14:11:24.692009 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 12/22] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 14:11:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:24.697902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d6eb5b69-8736-485f-bf62-0845f4eba135 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218e9dd8b0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:24.948949 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d6eb5b69-8736-485f-bf62-0845f4eba135 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.255381 Oct 05 14:11:24.949814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 13/23] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 14:11:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:25.229751 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b29dbb25-1b5c-431c-bfd3-e4d991e18341 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'create', calling method: .version_select at 0x7f218e0bfaf0>, body: {"keypair": {"name": "tempest-keypair-773430973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX/+hxjfUGHt0tO1q3X5ICW1saMrY3sQ7P2tdM+TO/EwvWz0OeLCndXnkZBIBlALNoq9+dFH/dUNaUvL5OIXokaSYLKUNh88/8M13UfLnC9NBiQNBK7ahhSZTWShQzQ+g=="}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:25.333726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-b29dbb25-1b5c-431c-bfd3-e4d991e18341 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for project 791692a741cd49af91cce92a0672b57a. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:11:25.354901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-b29dbb25-1b5c-431c-bfd3-e4d991e18341 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for user e805d10dcc2e4dc7baf6792c7ca53510 and project 791692a741cd49af91cce92a0672b57a. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:11:25.448509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b29dbb25-1b5c-431c-bfd3-e4d991e18341 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.487818 Oct 05 14:11:25.449803 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 14/24] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 14:11:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 490 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 14:11:25.466555 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6043e12e-5f26-4a0a-ae4f-92d8d6d594aa tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218dfd13a0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:25.719801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6043e12e-5f26-4a0a-ae4f-92d8d6d594aa tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.268749 Oct 05 14:11:25.725074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 15/25] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 5 14:11:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:25.740274 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-24f2b0ec-a40e-49dd-aa4b-20830299b790 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] Calling method '.version_select at 0x7f218dfd1ee0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:25.947973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-24f2b0ec-a40e-49dd-aa4b-20830299b790 tempest-VolumesTestJSON-1029662201 tempest-VolumesTestJSON-1029662201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.212837 Oct 05 14:11:25.948882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 16/26] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 14:11:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:26.329531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:11:26.330022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:11:26.330283 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:11:26.330691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:11:26.331101 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:11:26.375945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:26.376443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:26.376884 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:26.378665 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:26.379790 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:26.380385 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:26.426202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Getting quotas for project b44ac94c10c24033ac90cae24c9af051. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:11:26.446125 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Getting quotas for user 88c5474b1caa4618a81f5855a49ff515 and project b44ac94c10c24033ac90cae24c9af051. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:11:26.462358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:11:26.470718 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:11:26.705492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f1b628d1-f35a-4f3e-8047-380e5601b7a8 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.334082 Oct 05 14:11:26.706456 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 11/27] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:11:26.718746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-055bb51e-2551-481e-aa3f-efb496f66f5a tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:26.719501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-055bb51e-2551-481e-aa3f-efb496f66f5a tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:26.985304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-055bb51e-2551-481e-aa3f-efb496f66f5a tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:27.012974 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-055bb51e-2551-481e-aa3f-efb496f66f5a tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1214 microversion: 2.1 time: 0.297898 Oct 05 14:11:27.013866 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 17/28] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:26 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:28.040487 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2bc852a9-33cb-4f5a-8993-54a8a2607b41 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:28.041113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2bc852a9-33cb-4f5a-8993-54a8a2607b41 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:28.236245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2bc852a9-33cb-4f5a-8993-54a8a2607b41 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:28.277662 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2bc852a9-33cb-4f5a-8993-54a8a2607b41 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1214 microversion: 2.1 time: 0.242149 Oct 05 14:11:28.294246 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 12/29] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:28 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:29.302076 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-47bafda3-14cb-4538-8bf9-6d6c7eb8047e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:29.302708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-47bafda3-14cb-4538-8bf9-6d6c7eb8047e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:29.502444 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-47bafda3-14cb-4538-8bf9-6d6c7eb8047e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:29.509957 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-47bafda3-14cb-4538-8bf9-6d6c7eb8047e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1214 microversion: 2.1 time: 0.212214 Oct 05 14:11:29.519420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 18/30] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:29 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:30.317027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2358e668-5005-4f11-a53f-6e7a8a497a3d tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Action: 'create', calling method: .version_select at 0x7f218e00e3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-871425372", "metadata": {"Type": "work"}}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2358e668-5005-4f11-a53f-6e7a8a497a3d tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Request method failure captured: Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 121 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRhdVQfLtHlx7SrV2y_QDvQBKjtdiPZ5CcYK6zjLwoYXS1xD0CYJTX3Y5gSjbZsUvgeNP7oWBl0LovV45tO7Ey4F5GPLQHqFl4yQRxCRG-WWVrkWnSTDno8z8R4a74cvOTAphCmD6_E8AOkzci9_PW7BlSyVC2ojpjZijoBO8tEX0 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:30.326754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e80e29d641dd44ad992a698ca781c760"}]}] Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 935f62151a824a58b2b41c0d7f8b9ac9 Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-871425372", "metadata": {"Type": "work"}}} Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:30.327797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-871425372', 'metadata': {'Type': 'work'}}}} Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise error Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi '#$%' Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:30.328455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 14:11:30.335245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 14:11:30.336167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 14:11:30.336167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.336167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2358e668-5005-4f11-a53f-6e7a8a497a3d tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:30.336167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2358e668-5005-4f11-a53f-6e7a8a497a3d tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.527362 Oct 05 14:11:30.336167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 13/31] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 14:11:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 528 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:11:30.349779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c48e06bb-8edd-4a1a-a063-0755907c5a35 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Action: 'create', calling method: .version_select at 0x7f218d6b9b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2051597501", "metadata": {"Type": "work"}}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c48e06bb-8edd-4a1a-a063-0755907c5a35 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Request method failure captured: Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 120 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRhdVQfLtHlx7SrV2y_QDvQBKjtdiPZ5CcYK6zjLwoYXS1xD0CYJTX3Y5gSjbZsUvgeNP7oWBl0LovV45tO7Ey4F5GPLQHqFl4yQRxCRG-WWVrkWnSTDno8z8R4a74cvOTAphCmD6_E8AOkzci9_PW7BlSyVC2ojpjZijoBO8tEX0 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:30.350432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e80e29d641dd44ad992a698ca781c760"}]}] Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 935f62151a824a58b2b41c0d7f8b9ac9 Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2051597501", "metadata": {"Type": "work"}}} Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:30.351531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2051597501', 'metadata': {'Type': 'work'}}}} Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise error Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi '0' Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:30.352239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 14:11:30.353411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 14:11:30.354362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 14:11:30.354362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.354362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c48e06bb-8edd-4a1a-a063-0755907c5a35 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:30.362469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c48e06bb-8edd-4a1a-a063-0755907c5a35 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027119 Oct 05 14:11:30.365202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 14/32] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 14:11:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:11:30.376433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c38d738e-6af7-4544-b144-fd98d4c172ab tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Action: 'create', calling method: .version_select at 0x7f218d6beaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124733348", "metadata": {"Type": "work"}}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c38d738e-6af7-4544-b144-fd98d4c172ab tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Request method failure captured: Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 118 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRhdVQfLtHlx7SrV2y_QDvQBKjtdiPZ5CcYK6zjLwoYXS1xD0CYJTX3Y5gSjbZsUvgeNP7oWBl0LovV45tO7Ey4F5GPLQHqFl4yQRxCRG-WWVrkWnSTDno8z8R4a74cvOTAphCmD6_E8AOkzci9_PW7BlSyVC2ojpjZijoBO8tEX0 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:30.386908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e80e29d641dd44ad992a698ca781c760"}]}] Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 935f62151a824a58b2b41c0d7f8b9ac9 Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124733348", "metadata": {"Type": "work"}}} Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:30.388036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-124733348', 'metadata': {'Type': 'work'}}}} Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise error Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi '' Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:30.388695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 14:11:30.390377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 14:11:30.393041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 14:11:30.393041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.393041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c38d738e-6af7-4544-b144-fd98d4c172ab tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:30.393041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c38d738e-6af7-4544-b144-fd98d4c172ab tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017956 Oct 05 14:11:30.393041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 14:11:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:11:30.399020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7c1d461c-7bc2-4a9a-ab2b-fd967d4d6a16 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Calling method '.version_select at 0x7f218d6bee50>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:30.439059 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-7c1d461c-7bc2-4a9a-ab2b-fd967d4d6a16 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] HTTP exception thrown: Volume tempest-invalid-648006401 could not be found. Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7c1d461c-7bc2-4a9a-ab2b-fd967d4d6a16 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Request method failure captured: Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-648006401 HTTP/1.1 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRhdVQfLtHlx7SrV2y_QDvQBKjtdiPZ5CcYK6zjLwoYXS1xD0CYJTX3Y5gSjbZsUvgeNP7oWBl0LovV45tO7Ey4F5GPLQHqFl4yQRxCRG-WWVrkWnSTDno8z8R4a74cvOTAphCmD6_E8AOkzci9_PW7BlSyVC2ojpjZijoBO8tEX0 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:30.442384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e80e29d641dd44ad992a698ca781c760"}]}] Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 935f62151a824a58b2b41c0d7f8b9ac9 Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Volume tempest-invalid-648006401 could not be found. Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'tempest-invalid-648006401'} Oct 05 14:11:30.443469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-648006401 could not be found. (HTTP 404) (Request-ID: req-9d4bfbe4-8102-4dad-9887-8f532a1642d1) Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.444093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 14:11:30.444976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-648006401 could not be found. Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:30.446495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-648006401 could not be found. Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-648006401 could not be found. Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7c1d461c-7bc2-4a9a-ab2b-fd967d4d6a16 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Returning 404 to user: Volume tempest-invalid-648006401 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7c1d461c-7bc2-4a9a-ab2b-fd967d4d6a16 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-648006401" status: 404 len: 98 microversion: 2.1 time: 0.049026 Oct 05 14:11:30.448583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 16/34] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 5 14:11:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-648006401 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 14:11:30.456048 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3026bc32-b9bf-424d-93e3-81f79bf7376d tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005051 Oct 05 14:11:30.457206 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 14:11:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 14:11:30.466795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e369302d-258c-48c5-b0b7-62dec6a4852d tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003800 Oct 05 14:11:30.472856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 18/36] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 14:11:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 14:11:30.485092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-789841ff-54dc-46ad-b510-2c701ec15c94 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Calling method '.version_select at 0x7f218d6b9550>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:30.550971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-789841ff-54dc-46ad-b510-2c701ec15c94 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] HTTP exception thrown: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-789841ff-54dc-46ad-b510-2c701ec15c94 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Request method failure captured: Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/os-volumes/35869b85-24f9-4fc6-8806-3afd709214c6 HTTP/1.1 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRhdVQfLtHlx7SrV2y_QDvQBKjtdiPZ5CcYK6zjLwoYXS1xD0CYJTX3Y5gSjbZsUvgeNP7oWBl0LovV45tO7Ey4F5GPLQHqFl4yQRxCRG-WWVrkWnSTDno8z8R4a74cvOTAphCmD6_E8AOkzci9_PW7BlSyVC2ojpjZijoBO8tEX0 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:30.553656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e80e29d641dd44ad992a698ca781c760"}]}] Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 935f62151a824a58b2b41c0d7f8b9ac9 Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '35869b85-24f9-4fc6-8806-3afd709214c6'} Oct 05 14:11:30.554728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. (HTTP 404) (Request-ID: req-0ab053e4-64c9-449c-946f-cd0573f97767) Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.556228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 14:11:30.557123 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 14:11:30.558674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. Oct 05 14:11:30.560290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:30.562302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-789841ff-54dc-46ad-b510-2c701ec15c94 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Returning 404 to user: Volume 35869b85-24f9-4fc6-8806-3afd709214c6 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:30.563763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-789841ff-54dc-46ad-b510-2c701ec15c94 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/35869b85-24f9-4fc6-8806-3afd709214c6" status: 404 len: 109 microversion: 2.1 time: 0.083536 Oct 05 14:11:30.564491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 19/37] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:11:30 2022] DELETE /compute/v2.1/os-volumes/35869b85-24f9-4fc6-8806-3afd709214c6 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:11:30.578730 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:30.589989 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:30.605877 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:30.606728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:30.608325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:30.610067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:30.611856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:30.612510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:30.989419 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:31.026243 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-767cfa26-946f-4940-81e3-dae304b2d908 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1274 microversion: 2.1 time: 0.451152 Oct 05 14:11:31.029122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:30 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1274 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:31.041063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-53cf9638-aa3d-4422-8557-7e3158350d67 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Calling method '.version_select at 0x7f218d6beca0>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:31.119304 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-53cf9638-aa3d-4422-8557-7e3158350d67 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] HTTP exception thrown: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-53cf9638-aa3d-4422-8557-7e3158350d67 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Request method failure captured: Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/os-volumes/932cd479-2f2a-4484-83e4-d56db0b2b212 HTTP/1.1 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRhdVQfLtHlx7SrV2y_QDvQBKjtdiPZ5CcYK6zjLwoYXS1xD0CYJTX3Y5gSjbZsUvgeNP7oWBl0LovV45tO7Ey4F5GPLQHqFl4yQRxCRG-WWVrkWnSTDno8z8R4a74cvOTAphCmD6_E8AOkzci9_PW7BlSyVC2ojpjZijoBO8tEX0 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:11:31.121577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e80e29d641dd44ad992a698ca781c760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e80e29d641dd44ad992a698ca781c760"}]}] Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e80e29d641dd44ad992a698ca781c760 Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesNegativeTest-1428472133 Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 935f62151a824a58b2b41c0d7f8b9ac9 Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesNegativeTest-1428472133-project Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '932cd479-2f2a-4484-83e4-d56db0b2b212'} Oct 05 14:11:31.122639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. (HTTP 404) (Request-ID: req-66502506-ec2b-4848-8ded-61fd4a5c6833) Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:31.123257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:11:31.124295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 14:11:31.126224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. Oct 05 14:11:31.128285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:11:31.131582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-53cf9638-aa3d-4422-8557-7e3158350d67 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] Returning 404 to user: Volume 932cd479-2f2a-4484-83e4-d56db0b2b212 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:11:31.133025 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-53cf9638-aa3d-4422-8557-7e3158350d67 tempest-VolumesNegativeTest-1428472133 tempest-VolumesNegativeTest-1428472133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/932cd479-2f2a-4484-83e4-d56db0b2b212" status: 404 len: 109 microversion: 2.1 time: 0.102353 Oct 05 14:11:31.135256 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:11:31 2022] GET /compute/v2.1/os-volumes/932cd479-2f2a-4484-83e4-d56db0b2b212 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:11:31.217101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1217445433", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:31.369086 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] validate_networks() for [('9b437248-26e7-4fec-a6c0-2f104cafa80b', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:11:31.512330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1492882138", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8571f355-3b3e-4a98-979c-c47692c104dd"}], "security_groups": [{"name": "tempest-securitygroup--871657286"}], "key_name": "tempest-keypair-773430973", "user_data": "}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:31.791846 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] validate_networks() for [('8571f355-3b3e-4a98-979c-c47692c104dd', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:11:34.051320 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:11:34.052610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:11:34.053375 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:11:34.054011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:11:34.054654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:11:34.071945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:34.072900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:34.073881 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:34.074935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:34.075526 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:34.076714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:34.151066 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for project 791692a741cd49af91cce92a0672b57a. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:11:34.170103 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for user e805d10dcc2e4dc7baf6792c7ca53510 and project 791692a741cd49af91cce92a0672b57a. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:11:34.202175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:11:34.204531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:11:34.340835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bc8c5cca-14a5-48eb-8f08-ea8f54415327 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.834162 Oct 05 14:11:34.343873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 22/40] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 14:11:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 14:11:34.351770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:34.362278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:34.387106 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:34.387866 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:34.388530 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:34.389558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:34.390398 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:34.391196 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:34.829955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:11:34.830578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:11:34.830847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:11:34.831273 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:11:34.831692 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:11:34.842634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:34.851509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:34.852361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:34.855796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:34.856911 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:34.857647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:34.858001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c9286c11-f88c-49f3-8176-00391519d54d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.512768 Oct 05 14:11:34.859542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:34 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:34.868025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:34.884315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f179b268-6efa-4d27-9c3d-5b3515693110 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:34.886648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f179b268-6efa-4d27-9c3d-5b3515693110 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:34.990321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for project 80b3167e7ad94627b239bf680217ff61. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:11:35.005340 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for user 3603342a11f14f3d9edd7dbcbf08d72d and project 80b3167e7ad94627b239bf680217ff61. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:11:35.037769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:11:35.048114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:11:35.109851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f179b268-6efa-4d27-9c3d-5b3515693110 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:35.120052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f179b268-6efa-4d27-9c3d-5b3515693110 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:35.131514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f179b268-6efa-4d27-9c3d-5b3515693110 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:35.132704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f179b268-6efa-4d27-9c3d-5b3515693110 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1281 microversion: 2.20 time: 0.272015 Oct 05 14:11:35.133591 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 24/42] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:34 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:35.295756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-da38aee4-255f-4ec3-a49f-211241176fa0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.287349 Oct 05 14:11:35.308657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 19/43] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:11:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 5303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:11:35.324638 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-981622ed-b8d6-4d1f-aac2-429aa029bc4f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:35.331061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-981622ed-b8d6-4d1f-aac2-429aa029bc4f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:35.463967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-981622ed-b8d6-4d1f-aac2-429aa029bc4f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:35.474830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-981622ed-b8d6-4d1f-aac2-429aa029bc4f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1222 microversion: 2.1 time: 0.157242 Oct 05 14:11:35.480279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 25/44] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:35 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:35.888011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:35.888649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:35.904797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:35.906730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:35.915197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:35.918366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:35.919301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:35.919924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:36.116503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1931303883", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:36.250183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] validate_networks() for [('9b437248-26e7-4fec-a6c0-2f104cafa80b', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:11:37.281284 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:11:37.282005 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:11:37.282156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:11:37.282726 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:11:37.283287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:11:37.301934 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:37.302624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:37.305746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:37.307947 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:37.309855 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:37.311007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:37.349752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for project 80b3167e7ad94627b239bf680217ff61. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:11:37.359281 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for user 3603342a11f14f3d9edd7dbcbf08d72d and project 80b3167e7ad94627b239bf680217ff61. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:11:37.380154 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:11:37.383792 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:11:37.503223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-defc6e7d-acd1-49ff-b24b-98e6bee401b8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.391148 Oct 05 14:11:37.504526 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 26/45] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:11:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:11:37.519174 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:37.520130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:37.534899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:37.534899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:37.534899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:37.534899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:37.535321 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:37.535321 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:37.539108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:37.569504 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d34239c4-c8e0-40b1-a23f-00a9cf6e0a87 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 1.686284 Oct 05 14:11:37.581904 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 20/46] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:35 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:37.595426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9d77298b-2942-4326-98a5-2999530f602e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:37.596381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9d77298b-2942-4326-98a5-2999530f602e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:37.718731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:37.734582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:37.737538 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:37.741606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2e812a4b-f36c-4083-961d-03edb1da721e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1333 microversion: 2.20 time: 0.233724 Oct 05 14:11:37.753753 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 27/47] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:37 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1333 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:37.884659 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9d77298b-2942-4326-98a5-2999530f602e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:37.903598 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9d77298b-2942-4326-98a5-2999530f602e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1222 microversion: 2.1 time: 0.319649 Oct 05 14:11:37.917268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 21/48] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:37 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1222 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:38.611623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:38.612519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:38.626010 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:38.628111 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:38.629392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:38.635153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:38.635901 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:38.636371 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:38.771958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:38.773176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:38.788953 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:38.792749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:38.793241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:38.794003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:38.794474 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:38.794904 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:39.067887 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:39.085327 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:39.095060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:39.096492 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-52d3f4b0-0cda-4d9d-81a7-23c51ae73ee4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1339 microversion: 2.20 time: 0.328401 Oct 05 14:11:39.100103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 22/49] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:38 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1339 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:39.112097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:39.112987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:39.128013 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:39.128665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:39.129378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:39.130253 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:39.130854 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:39.131604 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:39.144225 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:39.152899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7a6ff399-b4c0-4dd7-a60f-629d75dff515 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.546955 Oct 05 14:11:39.153521 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 28/50] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:38 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:39.278683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:39.297395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c2045dab-147d-4a34-91c5-892bcd08c04a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1218 microversion: 2.1 time: 0.195090 Oct 05 14:11:39.314898 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 23/51] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:39 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:40.127678 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:40.128442 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:40.145039 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.145640 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.146137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.146927 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.147583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.148188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.268046 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:40.290192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:40.292681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:40.294226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-de7239f8-2d0b-43bc-91da-b2aa351ad750 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1339 microversion: 2.20 time: 0.170581 Oct 05 14:11:40.315636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 24/52] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:40 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:11:40.328318 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:40.332194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:40.350144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.355002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.355903 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.357259 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.358003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.359189 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.598003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd07f098-d82d-428d-a075-34707b15a830", "tag": "b49fff88-19aa-4943-9b75-c54406cbad21"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:40.635520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.636008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.636501 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.676173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Creating event network-changed:b49fff88-19aa-4943-9b75-c54406cbad21 for instance cd07f098-d82d-428d-a075-34707b15a830 on hv-cinder-83587 Oct 05 14:11:40.677689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 14:11:40.678328 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7972a2cd-c2d5-485e-ad4f-b896b1b99e52 req-ba2840b0-639e-40e9-bc07-5e9eac1547dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=120646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 14:11:40.679553 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.680263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.681091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.682117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.682736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.683323 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.704731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.compute.rpcapi [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 14:11:40.706893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] Releasing lock "compute-rpcapi-router" {{(pid=120646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 14:11:40.761253 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c9b64f4a-e0db-454a-90d6-45d017c91567 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.029284 Oct 05 14:11:40.771719 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 29/53] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:40.799714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:40.802238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:40.830647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.831546 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.833756 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:40.834760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:40.835987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:40.836855 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:41.213958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:41.225634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bfefbaa8-db4a-40bd-8776-01c1ac3adb07 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1274 microversion: 2.1 time: 0.451383 Oct 05 14:11:41.238054 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 30/54] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:40 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1274 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:41.330647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:41.331732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:41.339636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:41.348649 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:41.353075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e15e28ec-b492-4fdf-949e-53f9523fbc3e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 1.035601 Oct 05 14:11:41.354398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 25/55] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:40 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:41.360824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:41.361311 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:41.362073 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:41.366020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:41.366671 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:41.906332 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:41.920345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:41.925852 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:41.934378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-00fe063e-66d6-46f4-a2ef-fa8c80ffc9cf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.608055 Oct 05 14:11:41.950668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 31/56] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:41 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:11:42.254862 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:42.256155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:42.267543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:42.268046 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:42.268493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:42.269204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:42.269704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:42.270137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:42.376814 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:42.379513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:42.399362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:42.401799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:42.402710 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:42.403522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:42.403958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:42.404504 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:42.595493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:42.616038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c8dcfaa4-9273-450f-ba6d-595eea0e317e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1292 microversion: 2.1 time: 0.364659 Oct 05 14:11:42.616999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 26/57] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:42 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1292 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:42.967249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:42.968229 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:42.985138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:42.988488 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:42.989412 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:42.991451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:42.996599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c748d6c9-443e-47dd-a638-b9fa56a18109 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.624396 Oct 05 14:11:42.997218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:42.998464 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:43.001278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:43.001791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 32/58] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:42 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:11:43.640177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:43.641203 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:43.663814 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:43.665454 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:43.666118 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:43.667869 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:43.678271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:43.678919 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:43.824664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:43.842820 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d3d62593-0430-4536-8530-05c1293a9efd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1280 microversion: 2.1 time: 0.206638 Oct 05 14:11:43.843819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 33/59] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:43 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:44.028114 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:44.028837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:44.049581 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:44.052117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:44.055392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:44.062405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:44.063540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:44.066347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:44.447717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:44.464359 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:44.471250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:44.474420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-32d7b910-7b7c-46e4-8e5a-df72c7c7b85a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 1.514002 Oct 05 14:11:44.481586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 27/60] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:42 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:11:44.873612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:44.875163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:44.887955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:44.889742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:44.891372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:44.897443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:44.898231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:44.899417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:44.942339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:45.234473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:45.247880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-531b8509-9fbc-41f7-ba0c-4343cb18791d tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 1.224169 Oct 05 14:11:45.249566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 34/61] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:44 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:11:45.353749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:45.369986 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f5550e2b-f803-459a-b306-a6cc83e59ef8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1280 microversion: 2.1 time: 0.503386 Oct 05 14:11:45.389831 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 28/62] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:44 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1280 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:45.514796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:45.515552 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:45.527312 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:45.527815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:45.528260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:45.528995 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:45.529500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:45.536291 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.048220 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:46.058857 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:46.066400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:46.069387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:46.071111 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-eb5f61bf-f12c-4cd9-8321-608455cbf1b6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.560412 Oct 05 14:11:46.095717 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 35/63] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:45 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:46.123323 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.126565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.128426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.192055 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Creating event network-changed:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:11:46.192507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120645) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 14:11:46.193408 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2d434e8a-0c09-419d-ac66-66501bb2bbcc req-d90bf5ca-4bf4-45be-9b2a-ee45948cbb2e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120645) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 14:11:46.197802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.201181 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.201727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.204714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.205213 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.208999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.229681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.compute.rpcapi [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 14:11:46.237433 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] Releasing lock "compute-rpcapi-router" {{(pid=120645) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 14:11:46.269788 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-58c7d0a2-4a98-4916-94fa-4e9c40950ca9 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.681859 Oct 05 14:11:46.270716 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 29/64] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:11:46.281489 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:46.281489 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:46.314824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.314824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.315368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.317843 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.318337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.318777 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.402665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:46.403382 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:46.432516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.433247 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.433718 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.434452 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:46.434915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:46.435343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:46.660339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:46.673812 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-42449ed2-f512-4be5-b054-315ef29600fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1280 microversion: 2.1 time: 0.277396 Oct 05 14:11:46.675983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 30/65] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:46 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:11:47.038856 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-b0803d7b-168d-4529-9d7b-ca02994b17c1 req-70bb7317-880d-4239-9155-1f4ed50ae72f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6400a5f5-5a07-4b6d-8457-0856fddfc8cf", "tag": "54549e69-de73-4ad3-be2a-5c89b60c108e"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:47.056356 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b0803d7b-168d-4529-9d7b-ca02994b17c1 req-70bb7317-880d-4239-9155-1f4ed50ae72f service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:47.056830 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b0803d7b-168d-4529-9d7b-ca02994b17c1 req-70bb7317-880d-4239-9155-1f4ed50ae72f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:47.057852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b0803d7b-168d-4529-9d7b-ca02994b17c1 req-70bb7317-880d-4239-9155-1f4ed50ae72f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:47.084149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-b0803d7b-168d-4529-9d7b-ca02994b17c1 req-70bb7317-880d-4239-9155-1f4ed50ae72f service nova] Creating event network-changed:54549e69-de73-4ad3-be2a-5c89b60c108e for instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf on hv-cinder-83587 Oct 05 14:11:47.094932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-b0803d7b-168d-4529-9d7b-ca02994b17c1 req-70bb7317-880d-4239-9155-1f4ed50ae72f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061771 Oct 05 14:11:47.098481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 31/66] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:47.124092 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:47.124996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:47.137775 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:47.139063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:47.144494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:47.146591 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:47.148469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:47.149203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:47.237285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:47.248788 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-63d4b26d-f282-4bc6-9b4c-cb7e19f88932 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.977947 Oct 05 14:11:47.249591 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:46 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:47.514906 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:47.532619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:47.535163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:47.537264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fc891499-f0ec-4e92-80ac-30a390567d55 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.417452 Oct 05 14:11:47.551266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 32/68] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:47 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:47.713605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:47.715331 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:47.722727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=24 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:47.728325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:47.729688 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:47.730398 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:47.731335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:47.732012 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:47.732637 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:47.916116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:47.926021 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1188d0e5-5a6a-4987-a2f9-0ea26cc331a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.219325 Oct 05 14:11:47.926970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:47 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:48.277304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:48.278844 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:48.281585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=16 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:48.282885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:48.306021 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:48.306754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:48.308511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:48.309464 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:48.309943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:48.315263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:48.568743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:48.569785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:48.575713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:48.578120 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:48.578807 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:48.579410 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:48.582295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:48.583454 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:48.584972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:48.598977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a19794fe-daf3-438e-9669-3085c29c4917 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.327952 Oct 05 14:11:48.600027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:48 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:48.840399 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:48.852383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:48.854590 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:48.855943 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2304a91c-675e-4852-ab76-b840175dcdb4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.295720 Oct 05 14:11:48.856706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 38/71] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:48 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:48.949642 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:48.950933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:48.959212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:48.960099 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:48.960706 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:48.962921 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:48.963548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:48.964138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:49.402106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:49.412789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-70817491-3644-4c5e-94ff-9f9ae46d31ce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.468425 Oct 05 14:11:49.413373 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 34/72] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:48 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:49.624723 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:49.625655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:49.635951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:49.636700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:49.637409 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:49.639324 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:49.640050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:49.640913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:49.884562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:49.885395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:49.900890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:49.901425 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:49.908714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:49.910188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:49.913081 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:49.914697 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:50.130927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:50.143619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8e3b2a33-bf81-4419-9cd6-f7ceff737927 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.523522 Oct 05 14:11:50.145935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:49 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:50.256498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:50.279388 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:50.281143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:50.283407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e36e3da6-29b3-418a-b07d-04cd2c9eec97 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.403399 Oct 05 14:11:50.290536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 35/74] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:49 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:50.439354 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:50.439981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:50.451485 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:50.452433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:50.454309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:50.456133 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:50.458318 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:50.458984 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:50.699667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=8 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:50.927333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:50.930795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=100 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:50.943606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9a3866c9-6ea8-40b2-9574-47be01f6ee20 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.509780 Oct 05 14:11:50.953558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 40/75] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:50 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:51.170936 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:51.171599 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:51.182865 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:51.184265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:51.185138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:51.186015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:51.186672 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:51.187599 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:51.255218 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-9dabdcc6-d935-412f-8081-e834062a196f req-509ab1de-fa29-4c73-80b1-157d966a1329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c131c2bc-ef43-42f0-90d5-671c67ae78b4", "tag": "04cc93a2-faef-4af1-92a8-af294d38020e"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:51.266445 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-9dabdcc6-d935-412f-8081-e834062a196f req-509ab1de-fa29-4c73-80b1-157d966a1329 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:51.266923 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-9dabdcc6-d935-412f-8081-e834062a196f req-509ab1de-fa29-4c73-80b1-157d966a1329 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:51.267353 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-9dabdcc6-d935-412f-8081-e834062a196f req-509ab1de-fa29-4c73-80b1-157d966a1329 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:51.280330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-9dabdcc6-d935-412f-8081-e834062a196f req-509ab1de-fa29-4c73-80b1-157d966a1329 service nova] Creating event network-changed:04cc93a2-faef-4af1-92a8-af294d38020e for instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 on hv-cinder-83587 Oct 05 14:11:51.296978 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-9dabdcc6-d935-412f-8081-e834062a196f req-509ab1de-fa29-4c73-80b1-157d966a1329 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047546 Oct 05 14:11:51.297976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 41/76] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:11:51.315993 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:51.317665 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:51.343199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:51.343798 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:51.344330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:51.345124 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:51.345704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:51.346827 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:51.539204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:51.561983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a3a8774e-1d1d-474f-b830-f12c76a1e2dc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.396732 Oct 05 14:11:51.564392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:51 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:51.697536 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:51.707877 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:51.709366 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:51.710595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f2d4dc6c-d1ab-4104-8f74-45908387c3e8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.400125 Oct 05 14:11:51.711357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 42/78] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:51 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:11:51.982914 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:51.985258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:52.011698 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:52.012498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:52.015234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:52.020849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:52.020849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:52.020849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:52.362006 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:52.372092 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d90883c1-dbc2-41b8-99bd-5b8740fed28a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.398278 Oct 05 14:11:52.376201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:51 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:52.590649 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:52.592592 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:52.599410 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:52.601926 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:52.603126 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:52.603935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:52.604758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:52.606383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:52.606901 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:52.736255 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:52.736880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:52.745411 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:52.745915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:52.747489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:52.748588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:52.749058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:52.752017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:52.766580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:53.045095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:53.058680 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:53.060563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:53.062085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-015166f1-0d36-4ee5-9864-df8a9e3e3184 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.330208 Oct 05 14:11:53.065539 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 38/80] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:52 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:53.142694 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:53.166424 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d54b9f21-44d1-4bbe-be6f-2f2423e07d9e tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.581586 Oct 05 14:11:53.167479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 43/81] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:52 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:53.394947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:53.396196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:53.415644 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:53.416376 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:53.417804 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:53.421737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:53.422402 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:53.423874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:53.752234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:53.765471 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-63d32f98-03b6-4ed6-975d-0a8d979be47a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.374740 Oct 05 14:11:53.766072 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 39/82] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:53 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:54.091795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:54.093295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:54.100183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.100867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.102090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:54.103174 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.103848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.104699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:54.334712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:54.347533 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:54.350007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:54.351519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-30536634-5f1e-46a0-b664-02ae0e9f6be1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.263930 Oct 05 14:11:54.352572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 44/83] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:54 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:54.358397 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:54.359003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:54.364823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.365517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.366096 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:54.366973 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.367829 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.368391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:54.543153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:54.553443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9977fc59-4578-4a68-bd3f-329c54489309 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.199477 Oct 05 14:11:54.555566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 45/84] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:54 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:54.655663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-28d72b82-1580-44a9-9c78-87bbd30e70f5 req-57212c85-1eb4-4530-a6c4-0c79d99ccf14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "name": "network-vif-plugged", "status": "completed", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:54.666615 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-28d72b82-1580-44a9-9c78-87bbd30e70f5 req-57212c85-1eb4-4530-a6c4-0c79d99ccf14 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.667346 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-28d72b82-1580-44a9-9c78-87bbd30e70f5 req-57212c85-1eb4-4530-a6c4-0c79d99ccf14 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.668221 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-28d72b82-1580-44a9-9c78-87bbd30e70f5 req-57212c85-1eb4-4530-a6c4-0c79d99ccf14 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:54.681568 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-28d72b82-1580-44a9-9c78-87bbd30e70f5 req-57212c85-1eb4-4530-a6c4-0c79d99ccf14 service nova] Creating event network-vif-plugged:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:11:54.687196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-28d72b82-1580-44a9-9c78-87bbd30e70f5 req-57212c85-1eb4-4530-a6c4-0c79d99ccf14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.572633 Oct 05 14:11:54.688800 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 40/85] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:54.793522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:54.794822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:54.802876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.803935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.805211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:54.806299 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:54.806861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:54.807436 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:55.128202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:55.140957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1a831d7b-614b-46ac-9a02-d2097d5271b0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.350355 Oct 05 14:11:55.142718 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 46/86] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:54 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:55.377248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:55.378366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:55.388559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:55.389056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:55.389764 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:55.391218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:55.391917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:55.392500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:55.570596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:55.578209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:55.579083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:55.581084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:55.582920 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:55.584645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2ceec89b-40f2-4370-8233-073a2f8b0b2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.211728 Oct 05 14:11:55.585928 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 41/87] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:55 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:55.588186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:55.588679 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:55.589122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:55.589983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:55.590702 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:55.591143 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:55.793813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:55.802245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8b2d2257-50d1-4cb1-a226-7b0addc5f005 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.228549 Oct 05 14:11:55.817796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 47/88] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:55 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:11:56.169460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:56.170391 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:56.180499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.181962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.184158 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.186532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.187673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.188816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.230125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:56.396315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:56.404388 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-209eeced-d1f3-4097-ba8a-979332bfe030 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.240287 Oct 05 14:11:56.405079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 42/89] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:56 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:56.610192 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:56.611523 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:56.624901 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.625667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.626450 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.630261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.630745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.631356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.708385 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-ca1a155a-f0e0-4f08-a6a4-ffe703d27563 req-d6b51d34-42de-4f4f-b9b3-e86b6edde7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd07f098-d82d-428d-a075-34707b15a830", "name": "network-vif-plugged", "status": "completed", "tag": "b49fff88-19aa-4943-9b75-c54406cbad21"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:56.726724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ca1a155a-f0e0-4f08-a6a4-ffe703d27563 req-d6b51d34-42de-4f4f-b9b3-e86b6edde7e7 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.727537 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ca1a155a-f0e0-4f08-a6a4-ffe703d27563 req-d6b51d34-42de-4f4f-b9b3-e86b6edde7e7 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.728175 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ca1a155a-f0e0-4f08-a6a4-ffe703d27563 req-d6b51d34-42de-4f4f-b9b3-e86b6edde7e7 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.754038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-ca1a155a-f0e0-4f08-a6a4-ffe703d27563 req-d6b51d34-42de-4f4f-b9b3-e86b6edde7e7 service nova] Creating event network-vif-plugged:b49fff88-19aa-4943-9b75-c54406cbad21 for instance cd07f098-d82d-428d-a075-34707b15a830 on hv-cinder-83587 Oct 05 14:11:56.760552 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-ca1a155a-f0e0-4f08-a6a4-ffe703d27563 req-d6b51d34-42de-4f4f-b9b3-e86b6edde7e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056325 Oct 05 14:11:56.766207 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 43/90] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:11:56.823668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:56.828554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:56.829933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:56.834613 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:56.836676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:56.839977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b9c96eab-ecdd-408b-80d3-083513732f78 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1406 microversion: 2.20 time: 0.234355 Oct 05 14:11:56.841730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.842666 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.843260 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.844451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:56.845420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:56.846207 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:56.855794 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 48/91] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:56 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:57.098038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:57.111526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f29d727e-85ba-49c1-b84e-168c9632e506 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.288868 Oct 05 14:11:57.122266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 44/92] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:56 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:57.428268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:57.428987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:57.439918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:57.441646 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:57.444218 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:57.445817 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:57.446491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:57.447808 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:57.744377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:57.754268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5df29699-bfb5-4071-ad69-a9dcd90730f7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.330115 Oct 05 14:11:57.754835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 49/93] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:57 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:57.867801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:57.868416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:57.876060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:57.876696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:57.877469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:57.878180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:57.878708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:57.879108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.045320 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:58.054103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:58.073454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:58.075406 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5c5bd2ee-9b0c-48e2-a5b9-c201e93c0bed tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1596 microversion: 2.20 time: 0.211678 Oct 05 14:11:58.088097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 45/94] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:11:57 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1596 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:11:58.104486 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:58.105212 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:58.112763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.113524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.114172 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.115081 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.115739 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.116747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.141298 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:58.141298 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:58.147870 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.150424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.150869 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.152992 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.153584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.154014 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.271306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c1356181-37c1-4d52-917a-9482377697e9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.170683 Oct 05 14:11:58.271977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 50/95] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 14:11:58 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:11:58.376212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:58.388370 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-61865f76-590a-42fc-a1c0-dcd6c05fb541 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1314 microversion: 2.1 time: 0.254174 Oct 05 14:11:58.390189 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 46/96] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:58 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:58.778873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:58.778873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:58.786454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6400a5f5-5a07-4b6d-8457-0856fddfc8cf", "name": "network-vif-plugged", "status": "completed", "tag": "54549e69-de73-4ad3-be2a-5c89b60c108e"}, {"server_uuid": "c131c2bc-ef43-42f0-90d5-671c67ae78b4", "name": "network-vif-plugged", "status": "completed", "tag": "04cc93a2-faef-4af1-92a8-af294d38020e"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:11:58.812832 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.813362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.820724 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.821507 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.822008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.822446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.829684 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:58.830208 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:58.830647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:58.884750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] Creating event network-vif-plugged:54549e69-de73-4ad3-be2a-5c89b60c108e for instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf on hv-cinder-83587 Oct 05 14:11:58.885384 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] Creating event network-vif-plugged:04cc93a2-faef-4af1-92a8-af294d38020e for instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 on hv-cinder-83587 Oct 05 14:11:58.906900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-c9fa5f81-cfa8-4b91-9362-ddd9c073c95e req-09159de4-4d93-432b-a90e-ab45f6d52f68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125132 Oct 05 14:11:58.919282 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 47/97] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:11:59.320825 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:59.339709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-46dff074-f97a-4c09-8d15-61383340f8fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.563473 Oct 05 14:11:59.341397 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 51/98] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:58 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:11:59.415688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:11:59.416401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:11:59.423044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:59.423540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:59.424144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:59.425157 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:11:59.425796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:11:59.427820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:11:59.844867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:11:59.854328 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5082f361-ae33-4a4b-84ac-94cf5184e4cc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1501 microversion: 2.1 time: 0.444184 Oct 05 14:11:59.868877 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:11:59 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1501 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:00.367798 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:00.368424 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:00.379502 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:00.380031 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:00.380461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:00.381186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:00.381681 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:00.382110 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:00.412639 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-c742f7c4-998b-43cf-885d-f6853f8dd37a req-9ee298c0-cd14-4f5a-a010-30a8bf49d13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:00.426609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c742f7c4-998b-43cf-885d-f6853f8dd37a req-9ee298c0-cd14-4f5a-a010-30a8bf49d13a service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:00.427097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c742f7c4-998b-43cf-885d-f6853f8dd37a req-9ee298c0-cd14-4f5a-a010-30a8bf49d13a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:00.439956 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c742f7c4-998b-43cf-885d-f6853f8dd37a req-9ee298c0-cd14-4f5a-a010-30a8bf49d13a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:00.471113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-c742f7c4-998b-43cf-885d-f6853f8dd37a req-9ee298c0-cd14-4f5a-a010-30a8bf49d13a service nova] Creating event network-changed:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:12:00.481647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-c742f7c4-998b-43cf-885d-f6853f8dd37a req-9ee298c0-cd14-4f5a-a010-30a8bf49d13a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075609 Oct 05 14:12:00.482491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 49/100] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 05 14:12:00.711355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:00.720880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d230f793-0cff-4659-be20-7ee5e4cb1262 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1322 microversion: 2.1 time: 0.357589 Oct 05 14:12:00.723800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 52/101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:00 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:01.662956 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5bed2d8-61f8-4eb8-ba6e-fc3a267bb040"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:01.666894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:01.683379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:01.684063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:01.686409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:01.688465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:01.691462 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:01.692754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:01.746979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:01.748136 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:01.758371 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:01.759082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:01.761542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:01.762590 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:01.764167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:01.772098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:02.059799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:02.072326 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c268ac92-dbbc-4089-8046-6c04a79bcfbe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1516 microversion: 2.1 time: 0.330611 Oct 05 14:12:02.076780 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 53/102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:01 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:02.096465 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:02.106178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:02.120222 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:02.120732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:02.121181 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:02.125883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:02.127761 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:02.128230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:02.188755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lazy-loading 'flavor' on Instance uuid c131c2bc-ef43-42f0-90d5-671c67ae78b4 {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:12:02.410649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-64d9015d-d14d-4ea7-9c97-608a193c6ebc tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "POST /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753536 Oct 05 14:12:02.412078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 50/103] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:12:01 2022] POST /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:02.417433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-dab50674-6539-40d8-90a8-1fc8619bc1a3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4/action" status: 200 len: 32 microversion: 2.1 time: 0.320781 Oct 05 14:12:02.417433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 54/104] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:12:02 2022] POST /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:12:02.484159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:02.486331 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:02.518673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:02.519233 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:02.521023 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:02.523676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:02.527018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:02.531693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:02.942781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:02.950667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d266fa0a-4326-42b4-bb63-2e9afe354f86 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.512437 Oct 05 14:12:02.952110 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:02 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:03.979276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:03.980662 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:03.988657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:03.989345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:03.989805 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:03.990517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:03.990981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:03.991609 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:04.158941 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:04.167814 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3f091520-9d39-4602-82d2-717ae50d797a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.193032 Oct 05 14:12:04.170358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 55/106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:03 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:04.963874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:04.964441 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:04.970490 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:04.970969 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:04.971430 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:04.972114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:04.972563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:04.972982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:04.998753 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:12:05.088278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-750792db-4bd6-4a5b-9aa1-2c89652ef9d4 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 204 len: 0 microversion: 2.1 time: 0.128561 Oct 05 14:12:05.088851 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 52/107] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:12:04 2022] DELETE /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:12:05.097154 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:05.098133 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:05.104723 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:05.105199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:05.105667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:05.106350 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:05.106799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:05.107219 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:05.125309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:05.192879 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:05.193602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:05.205823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:05.206346 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:05.206784 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:05.207605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:05.208095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:05.208629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:05.240877 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:05.249800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e80ae6db-b530-4148-b02e-4f1db60311b7 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1553 microversion: 2.1 time: 0.156417 Oct 05 14:12:05.250301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:05 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:05.355459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:05.363842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-cc608620-6b6f-4e84-b3a5-c38d4a202bfc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.175581 Oct 05 14:12:05.364867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:05 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:06.276308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:06.277104 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:06.283624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:06.284121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:06.284707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:06.285457 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:06.289475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:06.290056 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:06.405062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:06.406561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:06.416160 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:06.417696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:06.418819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:06.420570 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:06.421907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:06.424719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:06.463450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:06.504891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:06.519772 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ae92457e-928a-4fb2-95cc-82f7aa38e75c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1553 microversion: 2.1 time: 0.249756 Oct 05 14:12:06.533977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:06 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:06.621063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:06.629655 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-701806e1-b7dc-4fb7-bd43-f6d2ef52dfc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.228316 Oct 05 14:12:06.630747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 54/111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:06 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:07.543895 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:07.545678 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:07.559838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:07.560599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:07.561895 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:07.564407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:07.566325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:07.566822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:07.653319 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:07.654073 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:07.668378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:07.669021 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:07.669618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:07.670949 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:07.673792 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:07.678231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:08.032320 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:08.044434 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-94407de6-9f11-433d-91a5-eca00635f264 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.394621 Oct 05 14:12:08.048110 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 55/112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:07 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:08.120428 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:08.147529 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-05fbff9f-6421-4504-aebf-049b691d5a42 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1553 microversion: 2.1 time: 0.608605 Oct 05 14:12:08.148647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:07 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1553 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:08.191156 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-2c44fd1c-6a1f-4418-95f4-8b8682e52f66 req-a4684195-043a-4f7b-b4df-a7ba1d206450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd07f098-d82d-428d-a075-34707b15a830", "name": "network-vif-deleted", "tag": "b49fff88-19aa-4943-9b75-c54406cbad21"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:08.214100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2c44fd1c-6a1f-4418-95f4-8b8682e52f66 req-a4684195-043a-4f7b-b4df-a7ba1d206450 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:08.214601 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2c44fd1c-6a1f-4418-95f4-8b8682e52f66 req-a4684195-043a-4f7b-b4df-a7ba1d206450 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:08.215045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2c44fd1c-6a1f-4418-95f4-8b8682e52f66 req-a4684195-043a-4f7b-b4df-a7ba1d206450 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:08.259627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-2c44fd1c-6a1f-4418-95f4-8b8682e52f66 req-a4684195-043a-4f7b-b4df-a7ba1d206450 service nova] Creating event network-vif-deleted:b49fff88-19aa-4943-9b75-c54406cbad21 for instance cd07f098-d82d-428d-a075-34707b15a830 on hv-cinder-83587 Oct 05 14:12:08.267409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-2c44fd1c-6a1f-4418-95f4-8b8682e52f66 req-a4684195-043a-4f7b-b4df-a7ba1d206450 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080315 Oct 05 14:12:08.268628 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 56/114] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:09.072848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:09.073519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:09.083195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:09.083832 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:09.084316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:09.085697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:09.086050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:09.086914 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:09.177681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:09.178238 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:09.185991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:09.186684 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:09.187138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:09.187892 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:09.188365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:09.188800 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:09.245166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:09.246027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:09.246878 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:09.247554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lazy-loading 'fault' on Instance uuid cd07f098-d82d-428d-a075-34707b15a830 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:12:09.309884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c5474b1caa4618a81f5855a49ff515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ac94c10c24033ac90cae24c9af051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:09.339161 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5edd89e4-de3b-4b3c-aa5c-4aa5a88c8f6c tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 200 len: 1350 microversion: 2.1 time: 0.157486 Oct 05 14:12:09.343344 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 57/115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:09 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 1350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:09.343616 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:09.356072 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7c27a6be-9379-4017-9d22-e254322b4b48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.286985 Oct 05 14:12:09.358213 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:09 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:10.364331 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:10.365056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:10.373482 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:10.373987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:10.374511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:10.375558 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:10.376077 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:10.376677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:10.382440 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:10.383284 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:10.391396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:10.392332 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:10.393037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:10.394034 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:10.394457 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:10.395254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:10.400173 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] HTTP exception thrown: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Request method failure captured: Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 HTTP/1.1 Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCKCumevurTqU-GH_Uq__8o8IgVZ6ZYjruRDakxUiQ8I3Z80joPKfETSwLa64-ZX9zPioPa1GPRg3zK8GKMJI4P7kVMFzaXeM7RAL9Iw0y2n_vkW1_f429fjIPuHew_R3QLVpX40UzqW0rVDpHSIcOfYVq_8JGzF0_tewoowmHXkmw Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:12:10.408270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b44ac94c10c24033ac90cae24c9af051"}]}] Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 88c5474b1caa4618a81f5855a49ff515 Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.409818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': 'cd07f098-d82d-428d-a075-34707b15a830'} Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:12:10.410619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.411932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.412973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Returning 404 to user: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:12:10.412973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f8fc5a97-8f59-42f9-ad1e-877cffeb8189 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 404 len: 111 microversion: 2.1 time: 0.052595 Oct 05 14:12:10.412973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:10 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:12:10.556364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:10.565190 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:10.565490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6cd73977-d75f-48b3-a11d-455133a4cffa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.188948 Oct 05 14:12:10.566085 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 60/118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:10 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:10.569513 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:10.577264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:10.577943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:10.578453 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:10.579213 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:10.579853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:10.580273 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:10.600270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] HTTP exception thrown: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Request method failure captured: Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830/os-volume_attachments HTTP/1.1 Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCKCumevurTqU-GH_Uq__8o8IgVZ6ZYjruRDakxUiQ8I3Z80joPKfETSwLa64-ZX9zPioPa1GPRg3zK8GKMJI4P7kVMFzaXeM7RAL9Iw0y2n_vkW1_f429fjIPuHew_R3QLVpX40UzqW0rVDpHSIcOfYVq_8JGzF0_tewoowmHXkmw Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:12:10.602997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b44ac94c10c24033ac90cae24c9af051"}]}] Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 88c5474b1caa4618a81f5855a49ff515 Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.604449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'server_id': 'cd07f098-d82d-428d-a075-34707b15a830'} Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:12:10.605351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:10.607719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:10.611040 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Returning 404 to user: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:12:10.614793 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4401b5b7-cdb6-4e9a-95e9-8e0980d99cf9 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055736 Oct 05 14:12:10.617063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:12:10 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 14:12:11.588163 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:11.589430 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:11.595281 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:11.595781 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:11.596342 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:11.597417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:11.598053 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:11.598636 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:11.780498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:11.808036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-aed68ab0-2135-4146-bccd-af75c0c0d824 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.219770 Oct 05 14:12:11.808685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 61/120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:11 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:11.913610 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:11.915036 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:11.926853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:11.927589 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:11.928017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:11.928904 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:11.929550 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:11.930134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:11.947277 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] HTTP exception thrown: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Request method failure captured: Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: DELETE /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 HTTP/1.1 Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCKCumevurTqU-GH_Uq__8o8IgVZ6ZYjruRDakxUiQ8I3Z80joPKfETSwLa64-ZX9zPioPa1GPRg3zK8GKMJI4P7kVMFzaXeM7RAL9Iw0y2n_vkW1_f429fjIPuHew_R3QLVpX40UzqW0rVDpHSIcOfYVq_8JGzF0_tewoowmHXkmw Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:12:11.949742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b44ac94c10c24033ac90cae24c9af051"}]}] Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 88c5474b1caa4618a81f5855a49ff515 Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:11.951182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': 'cd07f098-d82d-428d-a075-34707b15a830'} Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:12:11.952017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:11.953321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:11.955486 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Returning 404 to user: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:12:11.957086 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a37b6c6b-30c4-43ad-adea-30b1e7b46729 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 404 len: 111 microversion: 2.1 time: 0.048000 Oct 05 14:12:11.958113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 60/121] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:12:11 2022] DELETE /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:12:11.967311 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:11.968110 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] [instance: cd07f098-d82d-428d-a075-34707b15a830] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:11.975046 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:11.975591 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:11.976775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:11.977628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:11.978176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:11.978604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:11.995090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] HTTP exception thrown: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Request method failure captured: Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 HTTP/1.1 Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCKCumevurTqU-GH_Uq__8o8IgVZ6ZYjruRDakxUiQ8I3Z80joPKfETSwLa64-ZX9zPioPa1GPRg3zK8GKMJI4P7kVMFzaXeM7RAL9Iw0y2n_vkW1_f429fjIPuHew_R3QLVpX40UzqW0rVDpHSIcOfYVq_8JGzF0_tewoowmHXkmw Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:12:12.000086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b44ac94c10c24033ac90cae24c9af051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b44ac94c10c24033ac90cae24c9af051"}]}] Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b44ac94c10c24033ac90cae24c9af051 Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-DeleteServersTestJSON-746770807 Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 88c5474b1caa4618a81f5855a49ff515 Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-DeleteServersTestJSON-746770807-project Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:12.001600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'cd07f098-d82d-428d-a075-34707b15a830'} Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:12:12.002407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. Oct 05 14:12:12.003704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:12.004882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] Returning 404 to user: Instance cd07f098-d82d-428d-a075-34707b15a830 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:12:12.004882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c1223f75-6f2a-4b13-ad80-2b4b50c983f0 tempest-DeleteServersTestJSON-746770807 tempest-DeleteServersTestJSON-746770807-project] 10.222.0.16 "GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830" status: 404 len: 111 microversion: 2.1 time: 0.038793 Oct 05 14:12:12.004882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 62/122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:11 2022] GET /compute/v2.1/servers/cd07f098-d82d-428d-a075-34707b15a830 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:12:12.831202 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:12.831933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:12.841634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:12.842361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:12.843121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:12.843832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:12.844475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:12.845060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:13.122262 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:13.130447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dc0d3260-5f2c-4294-8103-19c86d1c1716 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.303118 Oct 05 14:12:13.132385 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:12 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:14.157261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:14.157881 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:14.170645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:14.171317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:14.171918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:14.172781 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:14.173536 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:14.174119 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:14.362461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:14.380903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a6069a5d-7050-4b74-976c-ff276d68e285 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.227431 Oct 05 14:12:14.384043 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 63/124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:14 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:15.407837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:15.408330 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:15.424979 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:15.425819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:15.426462 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:15.436275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:15.436918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:15.437401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:15.699027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:15.710529 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c2885e26-ea05-407f-9584-db073faa7abc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.306232 Oct 05 14:12:15.711350 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 62/125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:15 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:16.736888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:16.738876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:16.768427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:16.768427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:16.768427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:16.769163 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:16.769660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:16.774233 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:16.985260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:16.994271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-01616e48-543f-4574-9da1-f587f142741d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.263548 Oct 05 14:12:16.997306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 64/126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:16 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:18.018070 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:18.018721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:18.032294 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:18.034292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:18.034778 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:18.036476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:18.038280 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:18.039409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:18.222416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:18.239579 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e7e0d1ad-4c14-446a-b449-e9ea1dd2fec9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.225578 Oct 05 14:12:18.240494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 63/127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:18 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:19.265112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:19.266013 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:19.285655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:19.286293 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:19.286713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:19.287435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:19.288446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:19.288880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:19.582537 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:19.604406 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bce5acca-a718-45e3-b676-10b57316a1d7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.342651 Oct 05 14:12:19.607099 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 65/128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:19 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:20.630741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:20.633875 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:20.639112 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:20.659167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:20.661947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:20.663551 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:20.666851 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:20.669451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:20.670564 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:21.110959 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:21.129804 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-957c1231-d2ee-4e9c-8992-7474cf18c696 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.502085 Oct 05 14:12:21.131421 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 64/129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:20 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:22.157273 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:22.158067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:22.172963 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:22.173963 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:22.175104 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:22.177389 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:22.181529 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:22.182603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:22.466853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:22.483454 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3bbdc224-b7d8-47db-86a1-df4e1da97c48 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.331818 Oct 05 14:12:22.485585 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 66/130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:22 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:23.512930 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:23.514074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:23.542389 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:23.547188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:23.550272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:23.551098 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:23.555733 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:23.556202 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:23.925165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:23.937124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d4a6dc66-eadd-4cae-910b-393ebd824390 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.429585 Oct 05 14:12:23.939119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 65/131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:23 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:24.963359 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:24.964043 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:24.975859 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=47 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:24.987187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:24.987187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:24.987187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:24.987414 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:24.992972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:24.994411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:25.595470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:25.616546 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-51e02043-33dc-464c-9691-e70c85bc449b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.648509 Oct 05 14:12:25.617497 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 67/132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:24 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:26.642254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:26.642935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:26.650631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:26.651135 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:26.655086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:26.656030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:26.657675 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:26.658439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:27.115864 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6d03b221-df3e-4549-9413-637975e1bd65 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: .version_select at 0x7f218d4b30d0>, body: {"keypair": {"name": "tempest-keypair-249934817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCtjf8mA4S06geHIA8yP63vKYbhTA00t5CRILeRO5W4rzE9SYnnPxuJez6jzZFkvdJopSRCLYXTRVl8IsPKF+PeRa4MwLtH5xERB71ouBm2qfbIwF9/b8lVydWXpR4vw=="}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:27.134291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-6d03b221-df3e-4549-9413-637975e1bd65 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:12:27.138997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-6d03b221-df3e-4549-9413-637975e1bd65 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:12:27.173659 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6d03b221-df3e-4549-9413-637975e1bd65 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.662255 Oct 05 14:12:27.174651 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 66/133] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:12:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:27.217680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:27.232503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4cca5890-5276-43d1-a88a-6914a2c5db14 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.594254 Oct 05 14:12:27.233983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:26 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:28.262785 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:28.264289 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:28.282896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:28.284947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:28.286126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:28.289181 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:28.289949 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:28.292999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:28.563927 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:28.574222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d9de0b66-5a1e-44a2-a153-84a109425e5e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.316158 Oct 05 14:12:28.576714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:28 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:29.601011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:29.602544 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:29.616083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:29.618628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:29.619316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:29.622286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:29.623118 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:29.626360 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:29.769909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-481911719", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acdcb2d2-e854-4a1a-88ab-e50e826e09dc"}], "security_groups": [{"name": "tempest-securitygroup--1644145077"}], "key_name": "tempest-keypair-249934817", "user_data": "}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:29.935996 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:29.945574 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1f2d7a0d-4739-425f-8dbd-5ab721094bf4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.349252 Oct 05 14:12:29.946758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:29 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:30.000625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] validate_networks() for [('acdcb2d2-e854-4a1a-88ab-e50e826e09dc', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:12:30.236156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1861649697", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "networks": [{"uuid": "0f2b5e08-8fa5-4119-9e53-88a49c883488"}]}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:30.343331 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] validate_networks() for [('0f2b5e08-8fa5-4119-9e53-88a49c883488', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:12:30.580967 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:12:30.581414 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:12:30.581953 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:12:30.582280 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:12:30.582678 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:12:30.593964 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:30.594736 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:30.595365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:30.596393 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:30.597123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:30.597781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:30.626282 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:12:30.631498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:12:30.648387 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:12:30.651637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:12:30.751552 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-96c3a202-7d41-4979-8ba6-7ed4a77760c3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.985525 Oct 05 14:12:30.754566 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 68/137] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:12:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 14:12:30.810015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b5e13ce9-1f5a-45aa-88c7-049c8a59f536 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:30.812288 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b5e13ce9-1f5a-45aa-88c7-049c8a59f536 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:30.979434 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-b5e13ce9-1f5a-45aa-88c7-049c8a59f536 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:30.989113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b5e13ce9-1f5a-45aa-88c7-049c8a59f536 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1240 microversion: 2.1 time: 0.227717 Oct 05 14:12:31.006704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 69/138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:30 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:31.008266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:31.009051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:31.024368 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:31.025042 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:31.025747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:31.026562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:31.027255 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:31.027900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:31.188482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:12:31.189816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:12:31.190902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:12:31.191624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:12:31.192899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:12:31.208965 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:31.209957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:31.210478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:31.212977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:31.214481 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:31.217985 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:31.238610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Getting quotas for project 4ee184de1a764cb491848ac692efd21c. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:12:31.257115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Getting quotas for user f93fd1c9b91a4705a02229b909158004 and project 4ee184de1a764cb491848ac692efd21c. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:12:31.273274 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:12:31.278707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:12:31.296176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:31.309726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-756c4dd5-628c-4790-977e-d386d3eea3c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.316130 Oct 05 14:12:31.325255 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 70/139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:30 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:31.358513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7d2a3ca7-e72c-4e9b-b1df-26850c6c5968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126353 Oct 05 14:12:31.359566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 70/140] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 14:12:31.373450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3727904d-a9fa-43e0-8b8a-28d06084ac77 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:31.374129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3727904d-a9fa-43e0-8b8a-28d06084ac77 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:31.490663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3727904d-a9fa-43e0-8b8a-28d06084ac77 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:31.502893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3727904d-a9fa-43e0-8b8a-28d06084ac77 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1214 microversion: 2.1 time: 0.134312 Oct 05 14:12:31.505477 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 71/141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:31 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:32.025109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:32.026069 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:32.061599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:32.063981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:32.066382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:32.068271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:32.069086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:32.071267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:32.256571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:32.267342 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-52790596-fe80-41d9-8c5b-3e01e263bc26 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1236 microversion: 2.1 time: 0.248266 Oct 05 14:12:32.267924 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 71/142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:32 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1236 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:32.337995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:32.339027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:32.347746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:32.348241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:32.348852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:32.349600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:32.351032 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:32.351469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:32.525673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:32.527586 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:32.528618 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:32.533564 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f113c2e4-b484-4e9f-bfe7-6b0e7f6793e8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.202336 Oct 05 14:12:32.534254 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 72/143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:32 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:32.539460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:32.539953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:32.540384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:32.541083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:32.541577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:32.541992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:32.614202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:32.622098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8f32946e-170f-4599-910f-68fc1fbdbd1b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1210 microversion: 2.1 time: 0.098546 Oct 05 14:12:32.622605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 72/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:32 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:33.294412 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:33.295127 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:33.303862 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:33.304627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:33.305068 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:33.305814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:33.306274 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:33.306704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:33.375901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:33.385584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-df099658-6af3-4550-ad80-36624eb95cb8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1298 microversion: 2.1 time: 0.095086 Oct 05 14:12:33.390240 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 73/145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:33 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:33.561816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:33.562543 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:33.577316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:33.580280 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:33.581704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:33.585907 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:33.587121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:33.590470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:33.646143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:33.647287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:33.659165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:33.659660 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:33.661085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:33.661853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:33.662894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:33.663322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:33.948142 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:33.955964 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:33.964270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4254c00b-e8f4-4134-a939-c3c4636fe15a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.409045 Oct 05 14:12:33.967730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-992c886d-6b8d-41d0-b07b-d80cbcbb962b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1274 microversion: 2.1 time: 0.326110 Oct 05 14:12:33.968306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:33 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:33.979895 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:33 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:34.415786 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:34.418235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:34.426256 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:34.426732 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:34.427255 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:34.428642 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:34.429366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:34.429896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:34.678395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:34.689565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-28ac5e40-0da0-4a05-9adb-28bd43af080e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.279288 Oct 05 14:12:34.690848 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:34 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:34.876377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-9a9f16c5-91e0-4817-8bfd-52ac54bafeed req-33396165-faa9-41f9-8eb4-c776558e3c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a118798-a10a-4c6e-a661-74572c33dc01", "tag": "e2788610-56cd-4f83-8e15-a312fbac3726"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:34.888610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-9a9f16c5-91e0-4817-8bfd-52ac54bafeed req-33396165-faa9-41f9-8eb4-c776558e3c4d service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:34.889064 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-9a9f16c5-91e0-4817-8bfd-52ac54bafeed req-33396165-faa9-41f9-8eb4-c776558e3c4d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:34.889708 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-9a9f16c5-91e0-4817-8bfd-52ac54bafeed req-33396165-faa9-41f9-8eb4-c776558e3c4d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:34.906796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-9a9f16c5-91e0-4817-8bfd-52ac54bafeed req-33396165-faa9-41f9-8eb4-c776558e3c4d service nova] Creating event network-changed:e2788610-56cd-4f83-8e15-a312fbac3726 for instance 6a118798-a10a-4c6e-a661-74572c33dc01 on hv-cinder-83587 Oct 05 14:12:34.920550 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-9a9f16c5-91e0-4817-8bfd-52ac54bafeed req-33396165-faa9-41f9-8eb4-c776558e3c4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047812 Oct 05 14:12:34.921046 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 74/149] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:34.993272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:34.994589 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:34.995742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:34.996748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:35.000792 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:35.001656 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:35.002320 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:35.003053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:35.003507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:35.004095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:35.009601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:35.010381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:35.011243 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:35.012131 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:35.012611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:35.013176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:35.017998 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=100 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:35.222686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:35.222863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:35.234239 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-29a34cf1-c2cc-4eaf-ae8b-bc4d8b2278d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.246446 Oct 05 14:12:35.234826 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:34 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:35.269208 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8a1b7461-a59f-4630-8742-81098440ca9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.280283 Oct 05 14:12:35.270241 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:34 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:35.713437 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:35.714466 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:35.728600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:35.729104 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:35.729574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:35.730281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:35.730974 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:35.731407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:35.738868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:35.991890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:36.002127 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-29dbefcd-73de-44f3-a748-1f94cb406ffc tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.293174 Oct 05 14:12:36.002710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:35 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:36.192692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-f5afc14a-08b3-442b-a901-787f28e65f4e req-8151a697-24b1-44c9-ad39-a2f3eae0e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8", "tag": "da112b28-3752-45bb-be55-96657bab37ad"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:36.203163 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f5afc14a-08b3-442b-a901-787f28e65f4e req-8151a697-24b1-44c9-ad39-a2f3eae0e5c5 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:36.203637 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f5afc14a-08b3-442b-a901-787f28e65f4e req-8151a697-24b1-44c9-ad39-a2f3eae0e5c5 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:36.204061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f5afc14a-08b3-442b-a901-787f28e65f4e req-8151a697-24b1-44c9-ad39-a2f3eae0e5c5 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:36.215859 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-f5afc14a-08b3-442b-a901-787f28e65f4e req-8151a697-24b1-44c9-ad39-a2f3eae0e5c5 service nova] Creating event network-changed:da112b28-3752-45bb-be55-96657bab37ad for instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 on hv-cinder-83587 Oct 05 14:12:36.220732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-f5afc14a-08b3-442b-a901-787f28e65f4e req-8151a697-24b1-44c9-ad39-a2f3eae0e5c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031719 Oct 05 14:12:36.221395 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 76/153] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:12:36.258724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:36.259363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:36.265587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:36.266065 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:36.266681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:36.267532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:36.267987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:36.268411 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:36.294819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:36.296431 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:36.305451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:36.305451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:36.305773 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:36.306199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:36.306649 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:36.307237 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:36.468322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:36.477108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-813b8da2-37ab-4b2e-9b16-77996e933570 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1522 microversion: 2.1 time: 0.222167 Oct 05 14:12:36.489921 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:36 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:36.565946 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:36.573628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4f2de7ae-74d3-4a02-8c01-ea7e75f4a968 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.283155 Oct 05 14:12:36.574193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:36 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:37.026285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:37.027049 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:37.040623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.041047 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.041502 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.042194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.042651 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.043068 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.045041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-250772078", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:37.097334 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] validate_networks() for None {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:12:37.212147 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:37.220178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fc0be204-954d-4186-94cd-e7458241f3db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.198805 Oct 05 14:12:37.220750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:37 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:37.481068 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:12:37.481577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:12:37.482014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:12:37.482421 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:12:37.482833 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:12:37.491755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.492752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.493195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.493958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.494416 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.494840 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.502888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:37.503877 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:37.510691 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.511178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.511605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.512316 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.512770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.513243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.514140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Getting quotas for project 7f0c5c980cad411dac09cf81d1b7df88. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:12:37.518677 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Getting quotas for user 4a2749f4a6ef40ab9e92079de31d50a3 and project 7f0c5c980cad411dac09cf81d1b7df88. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:12:37.530171 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:12:37.532459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:12:37.598968 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-aa2d64c0-16d3-49dc-8bc9-e6748b89fe50 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557876 Oct 05 14:12:37.601193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 78/157] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 14:12:37.607056 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:37.607898 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:37.615988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.616615 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.616951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.618060 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.618676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.619333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.691257 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:37.704578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ed57e5f2-a131-4f53-88c0-ee6b0251eaa1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1502 microversion: 2.1 time: 0.205451 Oct 05 14:12:37.713120 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:37 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:37.718515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9e4c5f87-9f51-4cc9-b234-463c47f444c4 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:37.719268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9e4c5f87-9f51-4cc9-b234-463c47f444c4 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:37.794015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9e4c5f87-9f51-4cc9-b234-463c47f444c4 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:37.804325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9e4c5f87-9f51-4cc9-b234-463c47f444c4 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1214 microversion: 2.1 time: 0.090002 Oct 05 14:12:37.821078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 81/159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:37 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:37.821078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:37.821078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:37.827873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.830259 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.831666 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.832893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:37.833472 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:37.834016 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:37.834573 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:37.843356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a53671e7-269b-43f9-a27f-4f037d42f9bb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.240612 Oct 05 14:12:37.844517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 79/160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:37 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:37.979082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:37.989553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-39ccb597-e098-49ef-8c61-a7f76c0f26da tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1515 microversion: 2.1 time: 0.179313 Oct 05 14:12:37.990953 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 82/161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:37 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:38.245094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:38.245742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:38.251606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:38.252130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:38.252566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:38.253298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:38.253755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:38.254223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:38.396033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:38.404162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-663d67ee-6aa5-40f1-b024-a1649f271c6f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.164016 Oct 05 14:12:38.405088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 80/162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:38 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:38.829310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:38.830044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:38.836727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:38.837038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:38.837498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:38.838198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:38.838660 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:38.839261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:38.869085 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:38.870501 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:38.881921 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:38.882405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:38.882866 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:38.883558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:38.884011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:38.884432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:38.906802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:38.914440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-cde45682-0022-40d4-bdd9-2ab1ad1d064a tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1266 microversion: 2.1 time: 0.089034 Oct 05 14:12:38.915008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 83/163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:38 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:39.016129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:39.027684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-84df9af4-6f82-4952-bbb4-aa3ffd725948 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.164151 Oct 05 14:12:39.028677 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 81/164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:38 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:39.427508 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:39.428815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:39.430358 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:39.432674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:39.438847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.439332 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.439783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.441133 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.441411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.441688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.441887 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.442381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.442657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.443403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.444207 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.444319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.477209 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lazy-loading 'flavor' on Instance uuid 6400a5f5-5a07-4b6d-8457-0856fddfc8cf {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:12:39.579610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:39.590650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-32432dfa-d914-49aa-a9f1-cf45f16a61a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.166620 Oct 05 14:12:39.591276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:39 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:39.609189 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d83d15ee-3005-4cac-b04a-799e983aed37 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/action" status: 200 len: 32 microversion: 2.1 time: 0.189250 Oct 05 14:12:39.609886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 84/166] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:12:39 2022] POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:12:39.619255 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:39.619871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:39.625951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.626437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.626876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.627562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.628021 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.628445 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.764336 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:39.773211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ff01882b-4067-4d28-bf4b-77afbca5da4e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.157943 Oct 05 14:12:39.773868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:39 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:39.941026 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:39.941801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:39.951451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.952666 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.953121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:39.953885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:39.954349 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:39.954778 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.017535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:40.026741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0c29dee2-f3bd-428d-9b65-9f51d6560701 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1266 microversion: 2.1 time: 0.092059 Oct 05 14:12:40.027337 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:39 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:40.050837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:40.051451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:40.057435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:40.057917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:40.058351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.059033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:40.059486 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:40.059908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.194141 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:40.223276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ad88b6d1-2468-4086-9220-e417511c155b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.173482 Oct 05 14:12:40.223900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:40 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:40.617311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:40.617311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:40.618883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:40.622587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:40.623079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:40.623520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.624483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:40.625410 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:40.625940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.797037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:40.797722 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:40.804552 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:40.805046 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:40.805531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.806231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:40.806688 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:40.807115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:40.895800 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:40.907333 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b94a98b4-586d-48a1-be83-887a98b0d3d9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.295990 Oct 05 14:12:40.907909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:40 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:41.050492 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:41.051132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:41.057810 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.058295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.058726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:41.059415 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.059869 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.060290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:41.065999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:41.074928 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e807933b-c305-4264-b01b-151f87af132b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.282885 Oct 05 14:12:41.075816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 85/171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:40 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:41.145064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:41.154219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-28b43285-5d81-48d1-906f-b92840171208 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1272 microversion: 2.1 time: 0.107368 Oct 05 14:12:41.155493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 87/172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:41 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:41.248575 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:41.249189 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:41.258109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.258623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.259068 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:41.259824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.260288 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.260699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:41.520571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:41.529198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-eb98563c-87d1-497e-9695-ba7695770a3b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.285213 Oct 05 14:12:41.529920 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 86/173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:41 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:41.873188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-9ca16be3-d984-45d1-ad05-6ee0f9eeb582 req-4b512991-ad59-453f-a5ce-2976c6db11f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a118798-a10a-4c6e-a661-74572c33dc01", "name": "network-vif-plugged", "status": "completed", "tag": "e2788610-56cd-4f83-8e15-a312fbac3726"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:41.889769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-9ca16be3-d984-45d1-ad05-6ee0f9eeb582 req-4b512991-ad59-453f-a5ce-2976c6db11f6 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.890288 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-9ca16be3-d984-45d1-ad05-6ee0f9eeb582 req-4b512991-ad59-453f-a5ce-2976c6db11f6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.890729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-9ca16be3-d984-45d1-ad05-6ee0f9eeb582 req-4b512991-ad59-453f-a5ce-2976c6db11f6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:41.916910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-9ca16be3-d984-45d1-ad05-6ee0f9eeb582 req-4b512991-ad59-453f-a5ce-2976c6db11f6 service nova] Creating event network-vif-plugged:e2788610-56cd-4f83-8e15-a312fbac3726 for instance 6a118798-a10a-4c6e-a661-74572c33dc01 on hv-cinder-83587 Oct 05 14:12:41.923048 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-9ca16be3-d984-45d1-ad05-6ee0f9eeb582 req-4b512991-ad59-453f-a5ce-2976c6db11f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054844 Oct 05 14:12:41.923657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 88/174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:41.930025 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:41.931333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:41.944275 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.944811 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.945316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:41.946095 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:41.946713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:41.955644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.108095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:42.108918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:42.115243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.116035 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.116569 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.117846 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.118309 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.118927 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.165569 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:42.192193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3899c6b0-88ef-4b70-b668-9db64be61e5f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.266259 Oct 05 14:12:42.192821 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 87/175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:41 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:42.230951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:42.232439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:42.263102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.264040 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.264807 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.266137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.268655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.274385 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.333111 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:42.341742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-67520a17-6d04-44f5-96c1-5a9596d139bb tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.243669 Oct 05 14:12:42.342485 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 89/176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:42 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:42.356963 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-702755b0-a3ab-43c1-9290-d7dd29542f1c req-092d3856-0293-478f-b0f2-5e65bfbedc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f1f7ee-1af1-4776-97ac-0396d240202b", "tag": "2ba90190-8c75-4b78-a6c8-3c919187b071"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:42.369490 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-702755b0-a3ab-43c1-9290-d7dd29542f1c req-092d3856-0293-478f-b0f2-5e65bfbedc54 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.370063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-702755b0-a3ab-43c1-9290-d7dd29542f1c req-092d3856-0293-478f-b0f2-5e65bfbedc54 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.370566 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-702755b0-a3ab-43c1-9290-d7dd29542f1c req-092d3856-0293-478f-b0f2-5e65bfbedc54 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.383402 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-702755b0-a3ab-43c1-9290-d7dd29542f1c req-092d3856-0293-478f-b0f2-5e65bfbedc54 service nova] Creating event network-changed:2ba90190-8c75-4b78-a6c8-3c919187b071 for instance 92f1f7ee-1af1-4776-97ac-0396d240202b on hv-cinder-83587 Oct 05 14:12:42.389488 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-702755b0-a3ab-43c1-9290-d7dd29542f1c req-092d3856-0293-478f-b0f2-5e65bfbedc54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037735 Oct 05 14:12:42.390858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 90/177] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:42.441924 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:42.450222 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a4e4e1a9-bef8-4d7e-a072-40558fc88d33 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.231149 Oct 05 14:12:42.450798 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 88/178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:42 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:42.555121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:42.555847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:42.562531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.563034 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.563450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.564229 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:42.564683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:42.565128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:42.701319 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:42.709307 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7ded1d7f-ce95-40f3-87be-43de8cb33a91 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.159008 Oct 05 14:12:42.709880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 91/179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:42 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:43.215767 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:43.216476 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:43.222562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.223112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.223633 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.224992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.225548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.226041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.370400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:43.371729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:43.382027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.383500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.383952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:43.384314 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.385423 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.386117 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.386878 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.394680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-285ca42d-215c-4462-8875-826bc45eb4d0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1366 microversion: 2.1 time: 0.182645 Oct 05 14:12:43.395831 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 89/180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:43 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:43.474199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:43.475831 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:43.484342 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.484949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.485429 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.486144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.486604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.487331 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.652551 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:43.656194 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:43.661495 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f6128c41-49fa-4b62-b724-4ba2e72d353a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.299055 Oct 05 14:12:43.663168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 92/181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:43 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:43.669981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-dd052a18-0145-46e3-b5c6-6e94575fc166 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.200011 Oct 05 14:12:43.670671 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:43 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:43.734467 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:43.735090 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:43.743472 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.744055 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.745125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.746032 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.746895 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.747329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.902556 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:43.910103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-15d05473-7c5b-4105-9eb5-9f2a351a146f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.179609 Oct 05 14:12:43.910673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 93/183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:43 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:43.944465 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-651f8bb5-a9c5-40a6-9d38-9f721a94ae1a req-3045ec2e-4ae5-4175-a078-0f07682249f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8", "name": "network-vif-plugged", "status": "completed", "tag": "da112b28-3752-45bb-be55-96657bab37ad"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:43.954450 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-651f8bb5-a9c5-40a6-9d38-9f721a94ae1a req-3045ec2e-4ae5-4175-a078-0f07682249f9 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:43.954940 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-651f8bb5-a9c5-40a6-9d38-9f721a94ae1a req-3045ec2e-4ae5-4175-a078-0f07682249f9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:43.955438 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-651f8bb5-a9c5-40a6-9d38-9f721a94ae1a req-3045ec2e-4ae5-4175-a078-0f07682249f9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:43.969297 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-651f8bb5-a9c5-40a6-9d38-9f721a94ae1a req-3045ec2e-4ae5-4175-a078-0f07682249f9 service nova] Creating event network-vif-plugged:da112b28-3752-45bb-be55-96657bab37ad for instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 on hv-cinder-83587 Oct 05 14:12:43.974912 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-651f8bb5-a9c5-40a6-9d38-9f721a94ae1a req-3045ec2e-4ae5-4175-a078-0f07682249f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036062 Oct 05 14:12:43.975494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 91/184] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:44.422328 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:44.423031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:44.429978 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.430532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.431035 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.431814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.432334 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.432932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.436980 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:44.574242 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:44.582238 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dec08409-8211-4ec0-9eeb-c67b8b480272 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1556 microversion: 2.1 time: 0.164085 Oct 05 14:12:44.582820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 94/185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:44 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:44.605086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:44.605691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:44.611988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.612473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.612903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.613938 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.614399 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.614852 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.689320 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:44.690271 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:44.697648 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.698144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.698255 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-36ec9aff-7d90-48ce-b5f4-0a6a846df8f9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097104 Oct 05 14:12:44.698612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.698875 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 92/186] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:12:44 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:44.699315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.699917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.700612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.703938 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:44.704550 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:44.712150 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.712490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.712935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.713750 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.714265 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.714690 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.886157 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:44.897750 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e278afd0-10ce-4acb-b7e5-663267d68778 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.196995 Oct 05 14:12:44.899848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 93/187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:44 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:44.935807 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:44.936665 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:44.944555 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.948689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.949757 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.953800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:44.954452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:44.955224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:44.964067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=100 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:45.201075 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:45.219720 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f63acde4-56c3-4822-9ea4-da7ea0cffbcf tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.286984 Oct 05 14:12:45.220306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 94/188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:44 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:45.227104 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:45.227914 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:45.234612 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:45.235813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:45.236593 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:45.238738 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:45.240606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:45.242582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:45.283825 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0d64ed1d-cf39-4f6b-a340-71bdda43aaae tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/ips" status: 200 len: 150 microversion: 2.20 time: 0.060976 Oct 05 14:12:45.285329 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 95/189] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 5 14:12:45 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:12:45.377619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:45.389420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-492d4841-803d-4311-8cdb-3a194b7a9c9c tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.705776 Oct 05 14:12:45.390299 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:44 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:45.925908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:45.927127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:45.934178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:45.934672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:45.935113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:45.936563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:45.937249 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:45.937778 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:46.087634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:46.095708 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ec936fbe-d7e0-4612-bf11-84952b60dc8e tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.174257 Oct 05 14:12:46.109676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 96/191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:45 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:46.257449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:46.257449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:46.257449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:46.257449 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:46.258168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:46.258168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:46.258168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:46.258168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:46.413070 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:46.414071 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:46.420498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:46.421290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:46.422006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:46.423013 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:46.423670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:46.424202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:46.492473 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:46.500745 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d36a040a-29f8-4400-8f57-acd74e3da3e0 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1314 microversion: 2.1 time: 0.260712 Oct 05 14:12:46.501399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:46 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:46.582688 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:46.594314 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-06b3ff44-216b-4826-87bd-852f18a1c6f2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.186045 Oct 05 14:12:46.595070 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 97/193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:46 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:46.665959 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-2bba3520-e729-4824-b9f6-ada79bcb1e61 req-e093fe39-2c9e-43a0-b041-92a5d88a9e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a118798-a10a-4c6e-a661-74572c33dc01", "tag": "e2788610-56cd-4f83-8e15-a312fbac3726"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:46.676694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2bba3520-e729-4824-b9f6-ada79bcb1e61 req-e093fe39-2c9e-43a0-b041-92a5d88a9e14 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:46.677752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2bba3520-e729-4824-b9f6-ada79bcb1e61 req-e093fe39-2c9e-43a0-b041-92a5d88a9e14 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:46.678423 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-2bba3520-e729-4824-b9f6-ada79bcb1e61 req-e093fe39-2c9e-43a0-b041-92a5d88a9e14 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:46.705832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-2bba3520-e729-4824-b9f6-ada79bcb1e61 req-e093fe39-2c9e-43a0-b041-92a5d88a9e14 service nova] Creating event network-changed:e2788610-56cd-4f83-8e15-a312fbac3726 for instance 6a118798-a10a-4c6e-a661-74572c33dc01 on hv-cinder-83587 Oct 05 14:12:46.714176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-2bba3520-e729-4824-b9f6-ada79bcb1e61 req-e093fe39-2c9e-43a0-b041-92a5d88a9e14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052431 Oct 05 14:12:46.714948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 97/194] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:47.119975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:47.120576 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:47.126661 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.127149 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.127595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.128280 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.128737 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.129209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.257933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:47.265760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bdf732ef-3b93-4a32-86d5-cbb5a89b0b6d tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.149834 Oct 05 14:12:47.266320 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:47 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:47.524677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:47.525560 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:47.534515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:47.536525 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.537734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.538426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.539326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.539931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.540519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.619510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:47.620339 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:47.623063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=4 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:47.623355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=12 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:47.639168 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.639660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.640101 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.640939 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.641283 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.641697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.753600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:47.762131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d2b10c7b-6cc4-4cdb-bc71-eaedf871d38e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1498 microversion: 2.1 time: 0.241937 Oct 05 14:12:47.762716 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 98/196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:47 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:47.793054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-e28f0992-0b84-443e-93e1-183767c16312 req-911af3a3-2cc8-4e8d-866c-6985fd8bf733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f1f7ee-1af1-4776-97ac-0396d240202b", "name": "network-vif-plugged", "status": "completed", "tag": "2ba90190-8c75-4b78-a6c8-3c919187b071"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:47.805272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=16 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:47.807228 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e28f0992-0b84-443e-93e1-183767c16312 req-911af3a3-2cc8-4e8d-866c-6985fd8bf733 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:47.807717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e28f0992-0b84-443e-93e1-183767c16312 req-911af3a3-2cc8-4e8d-866c-6985fd8bf733 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:47.808152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e28f0992-0b84-443e-93e1-183767c16312 req-911af3a3-2cc8-4e8d-866c-6985fd8bf733 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:47.823941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-e28f0992-0b84-443e-93e1-183767c16312 req-911af3a3-2cc8-4e8d-866c-6985fd8bf733 service nova] Creating event network-vif-plugged:2ba90190-8c75-4b78-a6c8-3c919187b071 for instance 92f1f7ee-1af1-4776-97ac-0396d240202b on hv-cinder-83587 Oct 05 14:12:47.829167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-e28f0992-0b84-443e-93e1-183767c16312 req-911af3a3-2cc8-4e8d-866c-6985fd8bf733 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054189 Oct 05 14:12:47.829808 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 99/197] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:47.952490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:47.972045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0e0b10be-36d5-4391-b42b-d65c75d04240 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.357046 Oct 05 14:12:47.975027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 99/198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:47 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:48.118200 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:48.124414 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:48.138059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.138582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.140284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.142740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.143400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.145559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.177548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lazy-loading 'flavor' on Instance uuid 8a20e784-a0e0-498b-b35e-698c29824ce3 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:12:48.289715 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:48.290334 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:48.301102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.303770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.304308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.310908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.322333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.323405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.493177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1d086d9c-2857-4762-becd-56ed486a0adf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/action" status: 202 len: 0 microversion: 2.20 time: 0.384345 Oct 05 14:12:48.494285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 100/199] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 14:12:48 2022] POST /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:12:48.503347 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:48.503973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:48.511380 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.511869 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.512306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.513148 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.513554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.513979 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.637999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:48.645932 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-01c37777-1cda-4484-92f7-33b1ddf7397f tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.361742 Oct 05 14:12:48.646500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 100/200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:48 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:48.651091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:48.651579 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:48.657171 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.657703 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.658134 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.658817 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.659266 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.659687 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.660422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:48.670072 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:48.671693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:48.673147 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5dbb4dfc-5265-4e7b-b507-fac2126fd1d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.173829 Oct 05 14:12:48.674185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 101/201] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:48 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:12:48.694498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:12:48.765564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:48.780990 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a6577729-7854-48f7-8067-38cbea6159e6 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 204 len: 0 microversion: 2.1 time: 0.132987 Oct 05 14:12:48.781606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 101/202] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:12:48 2022] DELETE /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:12:48.789968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:48.790585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:48.796497 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.797121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.797586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.798281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:48.798739 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:48.799167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:48.934531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:48.942296 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c82c0758-fe6e-4529-af05-32a38a1237cb tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1504 microversion: 2.1 time: 0.156399 Oct 05 14:12:48.943494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 102/203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:48 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:48.999681 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:49.000470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:49.006159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.006648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.007089 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.007774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.008413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.008849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.143888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:49.151670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a1d0dc03-6a7f-419f-8544-0ed6e6e73dc1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.156423 Oct 05 14:12:49.152228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 102/204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:48 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:49.668897 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:49.669578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:49.676067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.676599 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.677027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.678271 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.678734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.679163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.702796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:49.703423 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:49.710323 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.710877 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.711319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.712160 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.712473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.712898 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.849880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:49.857421 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a61adfa4-89af-4a07-ac93-03c35d96db18 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1314 microversion: 2.1 time: 0.192699 Oct 05 14:12:49.858070 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 103/205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:49 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:49.887416 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:49.896890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:49.898418 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:49.899578 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2340ba4b-2fdb-4561-8bfd-e1f7ea6bda33 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.200951 Oct 05 14:12:49.900144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 103/206] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:49 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:12:49.965494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:49.966107 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:49.971900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.972383 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.972819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:49.976319 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:49.976814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:49.977430 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:50.107435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:50.116410 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8716371f-e3f2-447d-83f9-b14ded7807e7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1504 microversion: 2.1 time: 0.154794 Oct 05 14:12:50.117236 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 104/207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:49 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:50.174862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:50.175472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:50.181618 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:50.182097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:50.182527 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:50.183217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:50.183672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:50.184124 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:50.322012 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:50.329810 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-464f1089-f1c3-4cd0-bcec-51e9486769ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.158917 Oct 05 14:12:50.330382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 104/208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:50 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:50.880784 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:50.881618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:50.890955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:50.891472 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:50.891909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:50.892600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:50.893054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:50.893507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:50.925033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:50.926751 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:50.937635 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:50.938118 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:50.941345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:50.947135 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:50.947828 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:50.950620 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.096112 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.107194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-66efd02b-5005-4ec9-b9f1-04cc4e14bc59 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1464 microversion: 2.1 time: 0.230110 Oct 05 14:12:51.107770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 105/209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:50 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1464 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:51.140844 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:51.141539 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:51.146723 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.148633 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.150668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.151783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.154129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.154658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.155013 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.159248 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.163188 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.164641 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e54de433-cce6-409e-9bd4-a7def20bd98e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.244352 Oct 05 14:12:51.166966 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 105/210] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:50 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:12:51.172763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:51.178000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:51.185709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.186482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.187404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.188758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.189411 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.189977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.254278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:12:51.377760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.388164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2fad7c23-fed1-42f1-82e5-d58a9f7161de tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1504 microversion: 2.1 time: 0.251657 Oct 05 14:12:51.390101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 106/211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:51 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:51.394923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:51.395740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:51.403497 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.404322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.404915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.405848 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.406434 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.406986 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.418160 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-919e30dc-57d9-44cc-8638-fe8ca44134c8 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 204 len: 0 microversion: 2.1 time: 0.248653 Oct 05 14:12:51.419275 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:12:51 2022] DELETE /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:12:51.431558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:51.431785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:51.450367 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.450992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.451296 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.453604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.455517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.456299 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.591766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.599711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-13bfe1ea-a5b3-41a3-9950-2bb83db1c2f4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.208454 Oct 05 14:12:51.605537 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 107/213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:51 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:51.615072 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-5d3a74ea-2d28-4123-b596-c99af881e559 req-1d39cd51-830b-4a55-a223-cff2492e9a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8", "name": "network-vif-deleted", "tag": "da112b28-3752-45bb-be55-96657bab37ad"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:51.624849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5d3a74ea-2d28-4123-b596-c99af881e559 req-1d39cd51-830b-4a55-a223-cff2492e9a7f service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:51.625355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5d3a74ea-2d28-4123-b596-c99af881e559 req-1d39cd51-830b-4a55-a223-cff2492e9a7f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:51.625779 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5d3a74ea-2d28-4123-b596-c99af881e559 req-1d39cd51-830b-4a55-a223-cff2492e9a7f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:51.688333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:51.692076 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:51.709088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-82262aa9-1f4a-4bfb-b323-083d960eb026 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1470 microversion: 2.1 time: 0.283088 Oct 05 14:12:51.709746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 107/214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:51 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:51.784901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-5d3a74ea-2d28-4123-b596-c99af881e559 req-1d39cd51-830b-4a55-a223-cff2492e9a7f service nova] Creating event network-vif-deleted:da112b28-3752-45bb-be55-96657bab37ad for instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 on hv-cinder-83587 Oct 05 14:12:51.789966 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-5d3a74ea-2d28-4123-b596-c99af881e559 req-1d39cd51-830b-4a55-a223-cff2492e9a7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183100 Oct 05 14:12:51.790912 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 108/215] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:52.192231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:52.193728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:52.200330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.200810 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.201264 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.201988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.202431 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.202948 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.379797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:52.388856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:52.390365 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:52.391515 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-84b709fe-f1dc-40f2-bc81-9bd35abb45b1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.203474 Oct 05 14:12:52.392074 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 108/216] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:52 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:12:52.415144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:52.415841 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:52.422176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.422526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.422958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.423803 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.424416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.424994 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.512163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:52.519948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-296e4ca7-ac58-4aae-8519-b1d2525a031e tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1462 microversion: 2.1 time: 0.109458 Oct 05 14:12:52.520716 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 109/217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:52 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1462 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:52.629758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:52.631106 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:52.637158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.637671 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.638102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.638785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.639390 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.639962 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.736308 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:52.737159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:52.753132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.753828 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.754621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.755363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:52.755823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:52.756556 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:52.785959 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:52.795275 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0ab8075c-89d1-4e6f-a3e1-8f158e651988 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.169129 Oct 05 14:12:52.810177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 109/218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:52 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:52.910092 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:52.914192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:52.919441 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-84e7fa94-66e5-41c0-b326-55ada2c1c832 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1470 microversion: 2.1 time: 0.186949 Oct 05 14:12:52.920018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 110/219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:52 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:53.416614 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:53.417870 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:53.424266 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.424946 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.425566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.426404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.427027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.427596 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.560733 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:53.561940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:53.597385 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.601661 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.602283 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.603185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.603650 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.604392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.684481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.685302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.686291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.686937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lazy-loading 'fault' on Instance uuid ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:12:53.726311 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:53.743118 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:53.747428 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:53.753266 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bb709d22-3810-466d-8f18-1815f80be214 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.337956 Oct 05 14:12:53.757037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 110/220] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:53 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:12:53.795843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:53.806847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5ef1a6b3-bb12-4004-b54e-fc22f375d796 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 200 len: 1304 microversion: 2.1 time: 0.265285 Oct 05 14:12:53.807902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 111/221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:53 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 1304 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:53.815788 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-46beeeef-8304-45ba-8a33-732f4c9e6095 req-1e3c9c9d-df20-4230-a469-c11b9bd7fe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f1f7ee-1af1-4776-97ac-0396d240202b", "name": "network-vif-deleted", "tag": "2ba90190-8c75-4b78-a6c8-3c919187b071"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:53.828471 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:53.829416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:53.835689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-46beeeef-8304-45ba-8a33-732f4c9e6095 req-1e3c9c9d-df20-4230-a469-c11b9bd7fe7e service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.837587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.839123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.839452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-46beeeef-8304-45ba-8a33-732f4c9e6095 req-1e3c9c9d-df20-4230-a469-c11b9bd7fe7e service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.839992 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.840910 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-46beeeef-8304-45ba-8a33-732f4c9e6095 req-1e3c9c9d-df20-4230-a469-c11b9bd7fe7e service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.841736 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.842883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.843385 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.876531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-46beeeef-8304-45ba-8a33-732f4c9e6095 req-1e3c9c9d-df20-4230-a469-c11b9bd7fe7e service nova] Creating event network-vif-deleted:2ba90190-8c75-4b78-a6c8-3c919187b071 for instance 92f1f7ee-1af1-4776-97ac-0396d240202b on hv-cinder-83587 Oct 05 14:12:53.897348 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-46beeeef-8304-45ba-8a33-732f4c9e6095 req-1e3c9c9d-df20-4230-a469-c11b9bd7fe7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091976 Oct 05 14:12:53.904396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 111/222] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:12:53.945908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:53.946638 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:53.957087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.957536 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.957967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:53.959238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:53.959920 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:53.960497 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:54.006983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:54.007945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:54.008393 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:54.008841 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lazy-loading 'fault' on Instance uuid 92f1f7ee-1af1-4776-97ac-0396d240202b {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:12:54.063348 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:54.075153 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ed4793cc-36a6-4bc9-bd24-cbfdf0f02dc2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.259093 Oct 05 14:12:54.080607 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2749f4a6ef40ab9e92079de31d50a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0c5c980cad411dac09cf81d1b7df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:54.083849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 112/223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:53 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:54.090851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-05e386f6-afed-44bb-b3d5-d5e65c4caff9 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 200 len: 1304 microversion: 2.1 time: 0.150713 Oct 05 14:12:54.105777 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 112/224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:53 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:54.785556 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:54.786215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:54.793898 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:54.794588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:54.795034 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:54.795960 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:54.796329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:54.796962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:54.832090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:54.832970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:54.840205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:54.840913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:54.841470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:54.842525 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:54.843020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:54.843562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:54.869760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] HTTP exception thrown: Instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 could not be found. Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Request method failure captured: Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 HTTP/1.1 Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDLQrN-J2n8xFn797mjeKyB96ThQAUkQ-dbrzmpkrKhjpuKx2Ixc1NHEiJYMts2aSScZZ5dshpktKuqPtGH3nRe5DRQTYUabVuXdaUCd2d9VOyGjAm-A8LJ7x8NTv6JebrValhRc9D6fwlpi5RiiskfUoTmBLUSTFLkAlXZI20IAmE Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 4ee184de1a764cb491848ac692efd21c Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesActionsTest-217399415 Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:12:54.871816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ee184de1a764cb491848ac692efd21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ee184de1a764cb491848ac692efd21c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ee184de1a764cb491848ac692efd21c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ee184de1a764cb491848ac692efd21c"}]}] Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesActionsTest-217399415 Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 4ee184de1a764cb491848ac692efd21c Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesActionsTest-217399415 Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesActionsTest-217399415-project Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: f93fd1c9b91a4705a02229b909158004 Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesActionsTest-217399415-project Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 could not be found. Oct 05 14:12:54.873115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8'} Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 could not be found. Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:12:54.873890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 could not be found. Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 could not be found. Oct 05 14:12:54.875097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:12:54.876185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Returning 404 to user: Instance ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:12:54.876185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2caa8023-4742-4a0d-8e74-089580902a20 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8" status: 404 len: 111 microversion: 2.1 time: 0.046715 Oct 05 14:12:54.876185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:54 2022] GET /compute/v2.1/servers/ef7cc8a0-e8f0-47b9-a035-6f472ddc90f8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 14:12:54.976394 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:54.985179 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:54.986862 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:54.988018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-cf8d5144-6598-4f6b-8159-c93c09442015 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.206518 Oct 05 14:12:54.988603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 113/226] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:54 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:12:55.014161 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1574339660", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "networks": [{"uuid": "0f2b5e08-8fa5-4119-9e53-88a49c883488"}]}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:55.075536 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] validate_networks() for [('0f2b5e08-8fa5-4119-9e53-88a49c883488', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:12:55.106398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:55.107192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:55.113171 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:55.113648 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:55.114253 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:55.115545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:55.116158 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:55.116580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:55.268793 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:55.277551 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-484e63b5-c7e6-449c-8f59-99116d0a124d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.174845 Oct 05 14:12:55.278457 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 114/227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:55 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:12:55.283246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:55.284069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] [instance: 92f1f7ee-1af1-4776-97ac-0396d240202b] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:55.290185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:55.290906 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:55.291526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:55.292409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:55.293251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:55.293985 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:55.309177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] HTTP exception thrown: Instance 92f1f7ee-1af1-4776-97ac-0396d240202b could not be found. Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Request method failure captured: Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b HTTP/1.1 Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDT0LgYNHfokqr6-999VShVrbxUXTsSdi46PkFWAuCSd97WvPpl09yXxTmK0rd_7li-1RptYxCyFuqxEWVvrFUaeasMlClNA07qH1GldHXTl4NT0lFhQkRvXvLMv42h6ZrCfrouSdYIDLohF5_tv9XSAPXxGp8udLYEje6PbSfM0tQ Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 7f0c5c980cad411dac09cf81d1b7df88 Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-VolumesNegativeTest-1594259780 Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:12:55.311083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f0c5c980cad411dac09cf81d1b7df88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7f0c5c980cad411dac09cf81d1b7df88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f0c5c980cad411dac09cf81d1b7df88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7f0c5c980cad411dac09cf81d1b7df88"}]}] Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-VolumesNegativeTest-1594259780 Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 7f0c5c980cad411dac09cf81d1b7df88 Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-VolumesNegativeTest-1594259780 Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-VolumesNegativeTest-1594259780-project Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 4a2749f4a6ef40ab9e92079de31d50a3 Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-VolumesNegativeTest-1594259780-project Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 92f1f7ee-1af1-4776-97ac-0396d240202b could not be found. Oct 05 14:12:55.312460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '92f1f7ee-1af1-4776-97ac-0396d240202b'} Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f1f7ee-1af1-4776-97ac-0396d240202b could not be found. Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:12:55.313325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f1f7ee-1af1-4776-97ac-0396d240202b could not be found. Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f1f7ee-1af1-4776-97ac-0396d240202b could not be found. Oct 05 14:12:55.314536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:12:55.315619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] Returning 404 to user: Instance 92f1f7ee-1af1-4776-97ac-0396d240202b could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:12:55.315619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dbdc9a3b-8fc8-4e5a-ad0a-9bd2a619f4a5 tempest-VolumesNegativeTest-1594259780 tempest-VolumesNegativeTest-1594259780-project] 10.222.0.16 "GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b" status: 404 len: 111 microversion: 2.1 time: 0.032753 Oct 05 14:12:55.319504 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 115/228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:55 2022] GET /compute/v2.1/servers/92f1f7ee-1af1-4776-97ac-0396d240202b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:12:55.462764 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:12:55.463689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:12:55.464364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:12:55.464775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:12:55.465487 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:12:55.476035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:55.476586 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:55.477027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:55.478343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:55.478715 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:55.479542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:55.498477 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Getting quotas for project 4ee184de1a764cb491848ac692efd21c. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:12:55.503091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Getting quotas for user f93fd1c9b91a4705a02229b909158004 and project 4ee184de1a764cb491848ac692efd21c. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:12:55.515594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:12:55.518033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:12:55.568538 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-dd0726f9-9e13-418b-89ff-6a494a1a80d7 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557539 Oct 05 14:12:55.569388 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 114/229] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 14:12:55.584017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ff91b186-22e0-415a-ba42-7267b87daaab tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:55.584863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ff91b186-22e0-415a-ba42-7267b87daaab tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:55.706343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ff91b186-22e0-415a-ba42-7267b87daaab tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:55.717553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ff91b186-22e0-415a-ba42-7267b87daaab tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1214 microversion: 2.1 time: 0.137716 Oct 05 14:12:55.718432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 116/230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:55 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:56.018882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:56.019680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:56.034426 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:56.035163 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:56.035822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:56.037434 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:56.038837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:56.040048 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:56.269524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:56.278510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:56.280755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:56.282008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6b1f7fa3-a9ec-415d-8eac-9c8b4a201f71 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.267665 Oct 05 14:12:56.285325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 115/231] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:56 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:12:56.303194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:56.304358 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:56.311814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:56.312576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:56.316145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:56.316884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:56.318169 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:56.318610 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:56.535222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:56.551107 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-74480117-b17b-4d1e-a3ec-9378dded8816 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.253334 Oct 05 14:12:56.566177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 117/232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:56 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:56.740496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:56.741322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:56.748599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:56.749503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:56.750169 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:56.763004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:56.763616 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:56.765850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:56.867145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:56.876767 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-46eb45a3-2245-4e5c-a224-39dbacb63739 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1266 microversion: 2.1 time: 0.140643 Oct 05 14:12:56.877465 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 116/233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:56 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:57.308791 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:57.309874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:57.319435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:57.320003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:57.325514 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:57.327754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:57.328532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:57.341536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:57.545713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:57.561807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:57.563300 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:57.564752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2e7cf217-b519-4d4a-b581-9c944ae76e70 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.260262 Oct 05 14:12:57.565738 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 118/234] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:57 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:12:57.576858 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:57.578305 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:57.594556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:57.595054 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:57.595621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:57.596259 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:57.596828 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:57.597277 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:57.880262 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:57.890732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-46d2978e-e015-468d-bc8a-e919ddd4d75e tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.318092 Oct 05 14:12:57.891531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 117/235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:57 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:57.912479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:57.913411 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:57.920651 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:57.921467 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:57.922214 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:57.923157 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:57.923824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:57.924729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:57.995031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:58.004794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5a029880-1d76-43e9-be3b-67f51c9f729c tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1272 microversion: 2.1 time: 0.098015 Oct 05 14:12:58.005955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 119/236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:57 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:58.599903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:58.601137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:58.610000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:58.610546 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:58.610928 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:58.611623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:58.612070 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:58.612487 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:58.891247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:58.902974 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:58.904960 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:58.907196 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-382ae38e-5bb9-473d-b4f4-4f630c2d6318 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.311769 Oct 05 14:12:58.907951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 118/237] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:58 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:12:58.933491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:58.935021 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:58.941977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:58.943373 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:58.944082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:58.945396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:58.946265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:58.947784 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:59.027754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:59.028566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:59.041260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:59.041951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:59.042582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:59.043448 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:59.044078 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:59.044502 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:59.185183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:59.195506 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-795e9355-a711-466b-acdd-7049a38296b6 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.272875 Oct 05 14:12:59.196571 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 120/238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:58 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:59.202167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-ce63fd80-37c6-4821-ba4b-f64e98eb013a req-c823f073-105f-4324-a3cb-08ea6a694406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731657e1-0f28-4a43-9cc7-4cffe297d6ae", "tag": "65c1c2c0-e035-4a91-b4a2-4715ce79cecb"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:12:59.222084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ce63fd80-37c6-4821-ba4b-f64e98eb013a req-c823f073-105f-4324-a3cb-08ea6a694406 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:59.222733 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ce63fd80-37c6-4821-ba4b-f64e98eb013a req-c823f073-105f-4324-a3cb-08ea6a694406 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:59.223382 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ce63fd80-37c6-4821-ba4b-f64e98eb013a req-c823f073-105f-4324-a3cb-08ea6a694406 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:59.240682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-ce63fd80-37c6-4821-ba4b-f64e98eb013a req-c823f073-105f-4324-a3cb-08ea6a694406 service nova] Creating event network-changed:65c1c2c0-e035-4a91-b4a2-4715ce79cecb for instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae on hv-cinder-83587 Oct 05 14:12:59.247745 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-ce63fd80-37c6-4821-ba4b-f64e98eb013a req-c823f073-105f-4324-a3cb-08ea6a694406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048780 Oct 05 14:12:59.248823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 121/239] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:12:59.433036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:12:59.440899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-09786f5e-bf01-4de0-a984-cdeacf75cf2f tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1314 microversion: 2.1 time: 0.416875 Oct 05 14:12:59.454822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 119/240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:12:59 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:12:59.936977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:12:59.937797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:12:59.944432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:59.945001 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:59.945665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:12:59.946518 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:12:59.947008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:12:59.947447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:00.092939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:00.102250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:00.103829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:00.105006 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3c88cf09-b27b-4e14-b576-ad10cc4833e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.172852 Oct 05 14:13:00.105584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 122/241] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:12:59 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:00.228254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:00.229012 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:00.235629 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:00.236120 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:00.240030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:00.240881 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:00.241391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:00.241826 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:00.432620 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:00.441512 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2fe4996c-ecc7-4db9-b6d1-29c1e5da95b7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.218177 Oct 05 14:13:00.442916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 120/242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:00 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:00.465126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:00.465797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:00.472138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:00.472706 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:00.473217 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:00.474842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:00.475321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:00.475816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:00.618885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:00.626867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c47bc9a4-e348-479f-bf10-7b9c125737a1 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1314 microversion: 2.1 time: 0.166017 Oct 05 14:13:00.633419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 123/243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:00 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:01.133057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:01.133729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:01.139793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:01.140270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:01.140696 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:01.141416 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:01.141860 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:01.142443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:01.323490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:01.337414 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:01.338900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:01.340102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4a98901a-22fd-490b-a4a0-6ed4e2167fb1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.212803 Oct 05 14:13:01.340664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 121/244] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:01 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:01.469334 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:01.470510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:01.486714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:01.489808 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:01.490969 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:01.493055 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:01.495810 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:01.496728 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:01.650149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:01.655116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:01.656127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:01.662987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ae87880b-18ff-4a84-8c81-c5b88b06bd41 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.198980 Oct 05 14:13:01.666229 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:01 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:01.673351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:01.679450 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:01.680252 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:01.684326 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:01.685076 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:01.685623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:01.847818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:01.856617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0c07d0e3-fce9-4996-866e-8f2ecfbf9fa8 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1314 microversion: 2.1 time: 0.209694 Oct 05 14:13:01.874317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 122/246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:01 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:02.368239 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:02.368995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:02.376425 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:02.377496 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:02.378181 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:02.379429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:02.380851 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:02.381550 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:02.558172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:02.566637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:02.568367 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:02.569824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-96b360bb-5d9d-44ce-bdfb-772b3eda30af tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.207767 Oct 05 14:13:02.570951 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 125/247] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:02 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:02.687481 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:02.688096 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:02.695135 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:02.695684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:02.696050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:02.696898 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:02.697529 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:02.698206 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:02.852808 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:02.864449 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4952198f-7ddf-48ce-b150-58ed4075e15b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.181256 Oct 05 14:13:02.865642 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 123/248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:02 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:02.879855 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:02.880776 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:02.887068 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:02.887559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:02.887996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:02.888699 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:02.889156 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:02.889766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:03.053630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:03.063991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0e55fb9a-aab2-457b-bf35-cd91707e1073 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1314 microversion: 2.1 time: 0.187817 Oct 05 14:13:03.065135 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 126/249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:02 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:03.596896 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:03.597644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:03.605621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:03.606601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:03.607205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:03.609792 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:03.610544 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:03.611588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:03.753644 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-b977bebf-8053-4fa5-a04d-1f8353813af0 req-ab26b70c-1df7-49b1-9cb8-901f4ca31be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731657e1-0f28-4a43-9cc7-4cffe297d6ae", "name": "network-vif-plugged", "status": "completed", "tag": "65c1c2c0-e035-4a91-b4a2-4715ce79cecb"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:03.773099 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b977bebf-8053-4fa5-a04d-1f8353813af0 req-ab26b70c-1df7-49b1-9cb8-901f4ca31be7 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:03.773713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b977bebf-8053-4fa5-a04d-1f8353813af0 req-ab26b70c-1df7-49b1-9cb8-901f4ca31be7 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:03.774152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b977bebf-8053-4fa5-a04d-1f8353813af0 req-ab26b70c-1df7-49b1-9cb8-901f4ca31be7 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:03.796941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-b977bebf-8053-4fa5-a04d-1f8353813af0 req-ab26b70c-1df7-49b1-9cb8-901f4ca31be7 service nova] Creating event network-vif-plugged:65c1c2c0-e035-4a91-b4a2-4715ce79cecb for instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae on hv-cinder-83587 Oct 05 14:13:03.803227 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-b977bebf-8053-4fa5-a04d-1f8353813af0 req-ab26b70c-1df7-49b1-9cb8-901f4ca31be7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052990 Oct 05 14:13:03.804492 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 127/250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:03.890068 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:03.890788 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:03.897258 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:03.901035 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:03.901816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:03.902947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:03.903921 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:03.904572 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:03.905977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:03.917089 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:03.919786 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:03.922948 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2a48d191-4118-4d8d-b41e-3f86e139d552 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.330441 Oct 05 14:13:03.934122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 124/251] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:03 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:04.088329 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:04.088948 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:04.094941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:04.102128 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:04.102628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:04.103497 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:04.104528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:04.105358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:04.105933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:04.106841 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b2de3892-cf46-4633-8055-e91045eb6467 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.221951 Oct 05 14:13:04.109258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 128/252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:03 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:04.408211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:04.419169 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c3a6b069-31fc-49eb-a5a7-4caa0d5e0d6b tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1314 microversion: 2.1 time: 0.334899 Oct 05 14:13:04.433677 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 125/253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:04 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:04.959511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:04.961186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:04.968631 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:04.969511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:04.969939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:04.970957 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:04.971558 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:04.972125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.135837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:05.136607 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:05.139800 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:05.143388 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.144078 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.144732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.146086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.146637 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.147153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.148941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:05.150415 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:05.151575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-07cd48de-1145-4a7a-bc32-3b5986ae5566 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1742 microversion: 2.20 time: 0.196467 Oct 05 14:13:05.152295 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=100 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:05.152596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 129/254] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:04 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:05.282320 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:05.291112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c0f8afb6-f2d9-4626-9a42-7d292f9135a4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1501 microversion: 2.1 time: 0.162870 Oct 05 14:13:05.291675 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 126/255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:05 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:05.314324 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "222fe219-b83b-4869-a935-8555b47cda0c"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:05.316780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:05.322858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.323326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.323765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.324498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.324952 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.325401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.329058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:05.349251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] HTTP exception thrown: Cannot 'attach_volume' instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf while it is in vm_state rescued Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Request method failure captured: Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/os-volume_attachments HTTP/1.1 Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 74 Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCRux-cKlIsxHKons3jlj0EpYl9iCLTi9S7g_IXsvjrHcrmAK46phOyhwRGv2I7BCeQRR7k5N-vvFQE1scj3zB5fAJ3t_ZulRsNuz2kG7wgoJsNs68G5BAtD_noYNMI2xtnnfkpEfKxpi87AFC1_B5xPt2ltW-CVHk934q0iVaxtvg Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:13:05.350925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80b3167e7ad94627b239bf680217ff61"}]}] Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 3603342a11f14f3d9edd7dbcbf08d72d Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {"volumeAttachment": {"volumeId": "222fe219-b83b-4869-a935-8555b47cda0c"}} Oct 05 14:13:05.352400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Cannot 'attach_volume' instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf while it is in vm_state rescued Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'server_id': '6400a5f5-5a07-4b6d-8457-0856fddfc8cf', 'body': {'volumeAttachment': {'volumeId': '222fe219-b83b-4869-a935-8555b47cda0c'}}} Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:13:05.357059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf while it is in vm_state rescued Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:13:05.358545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf while it is in vm_state rescued Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Returning 409 to user: Cannot 'attach_volume' instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf while it is in vm_state rescued {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-74386ac2-0167-4127-a51f-7e7f81b1b525 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042338 Oct 05 14:13:05.359620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 130/256] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:13:05 2022] POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 14:13:05.361576 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:05.362102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:05.368854 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.369366 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.369796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.370475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.370925 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.371407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.443899 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:05.444839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:05.452016 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.452780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.453315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.454224 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.454684 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.454792 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-aaad94bb-61d1-4f72-8028-fed397ad6e53 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/action" status: 202 len: 0 microversion: 2.1 time: 0.096598 Oct 05 14:13:05.455114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.457500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 127/257] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:13:05 2022] POST /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 14:13:05.465518 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:05.477618 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:05.484847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.485569 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.486405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.487321 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:05.487787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:05.488221 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:05.488757 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:05.530271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:05.617340 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:05.625636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d754455c-89a4-4ce0-8525-9857d808671d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1314 microversion: 2.1 time: 0.186498 Oct 05 14:13:05.626298 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:05 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:05.775051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:05.783493 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-864f7b17-c297-46db-9790-5ccfb5ffed66 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1509 microversion: 2.1 time: 0.322625 Oct 05 14:13:05.784358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 128/259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:05 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:06.179645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:06.192202 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:06.193730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:06.205711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.207167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.207899 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.208850 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.209435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.209963 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.212434 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1325021668", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "networks": [{"uuid": "c0fdcd54-dc16-4bfa-83d9-972ce821061b"}]}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:06.281567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] validate_networks() for [('c0fdcd54-dc16-4bfa-83d9-972ce821061b', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:13:06.358535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:06.368474 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:06.369961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:06.371124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f5a3a52f-bd5b-4d25-8e58-a37573a33ed7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1742 microversion: 2.20 time: 0.192679 Oct 05 14:13:06.371718 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 132/260] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:06 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:06.650967 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:06.651634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:06.658211 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.658702 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.659252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.659832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.660819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.661989 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.670371 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:13:06.670850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:13:06.671334 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:13:06.671743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:13:06.672158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:13:06.684528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.685022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.685627 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.686504 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.687087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.687595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.726640 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Getting quotas for project c5e576ffa90d4118991edb48723664dc. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:13:06.730704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Getting quotas for user 5da7a95f6608401ab05b1dcf8767aa0f and project c5e576ffa90d4118991edb48723664dc. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:13:06.743668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:13:06.746384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:13:06.809820 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c4454837-6c62-4a0e-8094-a78fbf63a776 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601598 Oct 05 14:13:06.816595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 129/261] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:13:06.816595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:06.816595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:06.822941 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.823419 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.823865 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.824622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:06.828016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:06.828016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:06.868829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:06.877678 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ea5dba3a-34c4-4439-821e-2cf77292a817 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1497 microversion: 2.1 time: 0.230570 Oct 05 14:13:06.890295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 133/262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:06 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:06.903654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0572242d-c435-4c5a-92bd-4d347e888feb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:06.909535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0572242d-c435-4c5a-92bd-4d347e888feb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:07.019186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0572242d-c435-4c5a-92bd-4d347e888feb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:07.026137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:07.027734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0572242d-c435-4c5a-92bd-4d347e888feb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1219 microversion: 2.1 time: 0.135657 Oct 05 14:13:07.028811 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 134/263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:06 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:07.035109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3089a556-d532-4931-b60e-cf2ca79bc5dc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1509 microversion: 2.1 time: 0.223302 Oct 05 14:13:07.036443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:06 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:07.396751 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:07.397657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:07.404842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:07.405355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:07.405796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:07.406486 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:07.406942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:07.407370 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:07.523703 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:07.524360 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:07.530305 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:07.531008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:07.531448 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:07.532332 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:07.532944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:07.533550 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:07.561051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:07.561722 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:13:07.570970 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:07.572424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:07.574021 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d1d0428d-8e92-4359-939d-129ae5573ced tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1742 microversion: 2.20 time: 0.181689 Oct 05 14:13:07.574668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 135/265] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:07 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:07.637700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:07.652831 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-86551d2d-af76-472e-a6ad-0e8b1676501d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "DELETE /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 204 len: 0 microversion: 2.1 time: 0.133937 Oct 05 14:13:07.653609 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 131/266] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:13:07 2022] DELETE /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:13:07.662538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:07.663224 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:07.669906 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:07.670775 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:07.673125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:07.674056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:07.674656 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:07.675251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:07.813987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:07.821612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-32e88aa0-d638-41df-8801-eff2d8ac3c9d tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1503 microversion: 2.1 time: 0.163560 Oct 05 14:13:07.822177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 136/267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:07 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:08.052816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:08.053574 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:08.060056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:08.060736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.061125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:08.061307 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.061818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.062538 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.063244 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.064188 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.067783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.068265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.068701 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.069420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.070478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.070478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.128949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:08.137308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a0987c60-db63-4ed8-8177-3b98d84249b6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1223 microversion: 2.1 time: 0.089111 Oct 05 14:13:08.137896 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 132/268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:08 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:08.201887 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:08.210696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2c1e8ffd-4819-47fc-ac87-dba355439eaa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1509 microversion: 2.1 time: 0.154642 Oct 05 14:13:08.211292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 137/269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:08 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:08.601019 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:08.601694 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:08.608057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.608605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.609115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.610036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.610548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.611035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.760712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:08.768742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:08.770260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:08.771444 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2f4111b2-15ef-47b9-81f9-061cb8624388 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1742 microversion: 2.20 time: 0.174377 Oct 05 14:13:08.772158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 133/270] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:08 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:08.844879 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:08.845506 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:08.853958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.854675 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.855250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.856162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:08.856811 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:08.857263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:08.994955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:09.002836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2aad0339-b9d8-44d3-835f-73b658b343dd tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1503 microversion: 2.1 time: 0.161698 Oct 05 14:13:09.003406 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 138/271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:08 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:09.159850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:09.160461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:09.167415 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.167888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.168326 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.169031 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.169522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.169947 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.234460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:09.234654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:09.235209 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:09.241114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.241639 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.242341 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.242484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1cb45f66-dd12-4075-891a-53904a1cc430 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1223 microversion: 2.1 time: 0.086084 Oct 05 14:13:09.243019 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 134/272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:09 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:09.243154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.243567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.244070 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.382219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:09.389961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-52d6ae48-3d05-418a-a5ea-97c57d66b0a1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1509 microversion: 2.1 time: 0.160161 Oct 05 14:13:09.390518 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 139/273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:09 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:09.569563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-15246849-704b-4124-a904-eaf0df93ff12 req-49b0c8b5-2421-45ed-93cd-2888ee0c1b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "name": "network-vif-plugged", "status": "completed", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:09.579273 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-15246849-704b-4124-a904-eaf0df93ff12 req-49b0c8b5-2421-45ed-93cd-2888ee0c1b99 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.579755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-15246849-704b-4124-a904-eaf0df93ff12 req-49b0c8b5-2421-45ed-93cd-2888ee0c1b99 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.580176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-15246849-704b-4124-a904-eaf0df93ff12 req-49b0c8b5-2421-45ed-93cd-2888ee0c1b99 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.591626 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-15246849-704b-4124-a904-eaf0df93ff12 req-49b0c8b5-2421-45ed-93cd-2888ee0c1b99 service nova] Creating event network-vif-plugged:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:13:09.596927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-15246849-704b-4124-a904-eaf0df93ff12 req-49b0c8b5-2421-45ed-93cd-2888ee0c1b99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Oct 05 14:13:09.598355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 135/274] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:09.797133 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:09.797782 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:09.804257 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.804751 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.805193 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.805937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:09.806396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:09.806821 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:09.965275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:09.976405 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:09.978402 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:09.980311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1056ca04-377f-432a-9e5b-a0c361e0eaa6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1742 microversion: 2.20 time: 0.187349 Oct 05 14:13:09.981207 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 140/275] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:09 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:10.029730 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:10.030525 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:10.036784 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:10.037301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:10.037745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:10.038503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:10.038904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:10.039330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:10.181053 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:10.188681 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2a76cc0b-9a17-4957-8b43-acca2a8a6a86 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1503 microversion: 2.1 time: 0.166288 Oct 05 14:13:10.189314 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 136/276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:10 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:10.265077 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:10.265727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:10.273379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:10.274577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:10.275026 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:10.275738 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:10.276202 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:10.276628 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:10.337726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:10.345350 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ed893130-cbc6-4ab1-bbb4-2ef27b574ef3 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1223 microversion: 2.1 time: 0.084110 Oct 05 14:13:10.345915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 141/277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:10 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:10.414302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:10.414939 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:10.420924 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:10.421478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:10.421877 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:10.422560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:10.423010 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:10.423430 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:10.554085 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:10.562126 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-aaa25e32-e570-4a2b-b272-6a9fe32a2c87 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1515 microversion: 2.1 time: 0.151708 Oct 05 14:13:10.562681 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 137/278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:10 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:11.007565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:11.008471 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:11.023988 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.024637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.025058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.026395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.026507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.026940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.204407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:11.212853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:11.214335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:11.216954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:11.219325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:11.227569 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.228305 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.229198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.230159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.230270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e3be0829-44a3-4423-9876-86f3cc9eb84f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.226874 Oct 05 14:13:11.232338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 142/279] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:11 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:11.242221 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.252260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.368409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:11.369088 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:11.375376 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.376071 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.376510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.377443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.378246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.378838 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.384867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:11.400728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f9edf3d8-b27b-4014-a0f5-00263ee3d1fe tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1461 microversion: 2.1 time: 0.191816 Oct 05 14:13:11.401731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 138/280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:11 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1461 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:11.433659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-b839139c-2705-43c8-a1e7-35d0d7d7a7fd req-29c2cc07-94dd-40c8-a9e2-e2cf0b28c49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731657e1-0f28-4a43-9cc7-4cffe297d6ae", "name": "network-vif-deleted", "tag": "65c1c2c0-e035-4a91-b4a2-4715ce79cecb"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:11.443616 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-b839139c-2705-43c8-a1e7-35d0d7d7a7fd req-29c2cc07-94dd-40c8-a9e2-e2cf0b28c49c service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:11.444391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-b839139c-2705-43c8-a1e7-35d0d7d7a7fd req-29c2cc07-94dd-40c8-a9e2-e2cf0b28c49c service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:11.444886 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-b839139c-2705-43c8-a1e7-35d0d7d7a7fd req-29c2cc07-94dd-40c8-a9e2-e2cf0b28c49c service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:11.449716 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:11.458212 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-b839139c-2705-43c8-a1e7-35d0d7d7a7fd req-29c2cc07-94dd-40c8-a9e2-e2cf0b28c49c service nova] Creating event network-vif-deleted:65c1c2c0-e035-4a91-b4a2-4715ce79cecb for instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae on hv-cinder-83587 Oct 05 14:13:11.459426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9c2ec35b-c95b-4f5e-8a9d-680f30ba8619 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1271 microversion: 2.1 time: 0.095457 Oct 05 14:13:11.463631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-b839139c-2705-43c8-a1e7-35d0d7d7a7fd req-29c2cc07-94dd-40c8-a9e2-e2cf0b28c49c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Oct 05 14:13:11.464025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 143/281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:11 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:11.464344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 139/282] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:11.984521 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-88503396-b09c-4cf9-a2d6-0fa75e0c9649 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'create', calling method: .version_select at 0x7f218d45fd30>, body: {"keypair": {"name": "tempest-keypair-598333004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPC86lGCtiZBkA72612+6Cf79IIYn93wIp7DlHZNr4L+MsxUMzv3OgwcFbDMlmzXfr+93PECv+w52JkzRiHqxWDRmdj5Q8tQPidTV5P1u+XUrW40kYAk6Ewt7B/EhLIxw=="}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:12.000847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:12.017329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-88503396-b09c-4cf9-a2d6-0fa75e0c9649 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for project 80b3167e7ad94627b239bf680217ff61. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:13:12.027079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-88503396-b09c-4cf9-a2d6-0fa75e0c9649 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for user 3603342a11f14f3d9edd7dbcbf08d72d and project 80b3167e7ad94627b239bf680217ff61. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:13:12.102663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-88503396-b09c-4cf9-a2d6-0fa75e0c9649 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122062 Oct 05 14:13:12.103273 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 144/283] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:13:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:12.262608 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:12.263302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:12.272969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.275729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.276868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.279614 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.280351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.286793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.425248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:12.425860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:12.437950 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.442552 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.443411 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.444511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.445147 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.445779 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.496831 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.497617 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.498212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.498821 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lazy-loading 'fault' on Instance uuid 731657e1-0f28-4a43-9cc7-4cffe297d6ae {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:13:12.580094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93fd1c9b91a4705a02229b909158004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee184de1a764cb491848ac692efd21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:12.595384 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fd8424fe-336f-4e20-9ecf-259b1801a657 tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 200 len: 1304 microversion: 2.1 time: 0.172584 Oct 05 14:13:12.597382 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 145/284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:12 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:12.614232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:12.615200 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:12.652466 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.653275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.653963 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.667333 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:12.668362 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:12.671983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:12.765827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:12.774909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-15e38608-185b-4762-a6d7-fa620418761c tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1277 microversion: 2.1 time: 0.174269 Oct 05 14:13:12.777115 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 146/285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:12 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:12.792239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:12.801876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:12.807509 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:12.810588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8520001c-ff65-4938-bdd8-c324a1f92351 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.553335 Oct 05 14:13:12.812850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 140/286] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:12 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:13.623805 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:13.625264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] [instance: 731657e1-0f28-4a43-9cc7-4cffe297d6ae] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:13.637129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:13.637961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:13.638613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:13.639719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:13.643810 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:13.646724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:13.686761 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] HTTP exception thrown: Instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae could not be found. Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Request method failure captured: Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae HTTP/1.1 Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDLQrN-J2n8xFn797mjeKyB96ThQAUkQ-dbrzmpkrKhjpuKx2Ixc1NHEiJYMts2aSScZZ5dshpktKuqPtGH3nRe5DRQTYUabVuXdaUCd2d9VOyGjAm-A8LJ7x8NTv6JebrValhRc9D6fwlpi5RiiskfUoTmBLUSTFLkAlXZI20IAmE Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 4ee184de1a764cb491848ac692efd21c Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-VolumesActionsTest-217399415 Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:13:13.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ee184de1a764cb491848ac692efd21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ee184de1a764cb491848ac692efd21c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ee184de1a764cb491848ac692efd21c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ee184de1a764cb491848ac692efd21c"}]}] Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-VolumesActionsTest-217399415 Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 4ee184de1a764cb491848ac692efd21c Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-VolumesActionsTest-217399415 Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-VolumesActionsTest-217399415-project Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: f93fd1c9b91a4705a02229b909158004 Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-VolumesActionsTest-217399415-project Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae could not be found. Oct 05 14:13:13.689806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '731657e1-0f28-4a43-9cc7-4cffe297d6ae'} Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae could not be found. Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:13:13.690645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae could not be found. Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae could not be found. Oct 05 14:13:13.692448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:13:13.693712 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] Returning 404 to user: Instance 731657e1-0f28-4a43-9cc7-4cffe297d6ae could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:13:13.693712 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9b25f1c8-94ba-43bc-88c0-df5b0f365fad tempest-VolumesActionsTest-217399415 tempest-VolumesActionsTest-217399415-project] 10.222.0.16 "GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae" status: 404 len: 111 microversion: 2.1 time: 0.070224 Oct 05 14:13:13.705390 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 147/287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:13 2022] GET /compute/v2.1/servers/731657e1-0f28-4a43-9cc7-4cffe297d6ae => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:13:13.800564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:13.801210 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:13.810809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:13.811091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:13.812527 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:13.816507 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:13.818048 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:13.818763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:13.852859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:13.852859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:13.852859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:13.852859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:13.853743 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:13.856691 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:13.857796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:13.860618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:14.154053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:14.166624 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:14.168080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:14.176915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a88ac2b5-279f-44a1-8ab6-2c804ada8fdd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.331082 Oct 05 14:13:14.191750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 148/288] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:13 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:14.257801 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:14.265474 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-87764355-4997-4246-bf15-4d0d720630c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.468833 Oct 05 14:13:14.272476 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 141/289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:13 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:14.925583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-977bcf2b-328a-4ce2-9848-cb4066b496c1 req-96cd4bb3-051b-4f6c-8050-febde734707c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c97bc1-1b97-4fb6-ae36-51f8722ee72a", "tag": "efc62756-9332-4108-9df2-4d6ad291baa6"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:14.947842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-977bcf2b-328a-4ce2-9848-cb4066b496c1 req-96cd4bb3-051b-4f6c-8050-febde734707c service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:14.949054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-977bcf2b-328a-4ce2-9848-cb4066b496c1 req-96cd4bb3-051b-4f6c-8050-febde734707c service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:14.949673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-977bcf2b-328a-4ce2-9848-cb4066b496c1 req-96cd4bb3-051b-4f6c-8050-febde734707c service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:14.972873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-977bcf2b-328a-4ce2-9848-cb4066b496c1 req-96cd4bb3-051b-4f6c-8050-febde734707c service nova] Creating event network-changed:efc62756-9332-4108-9df2-4d6ad291baa6 for instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a on hv-cinder-83587 Oct 05 14:13:14.979878 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-977bcf2b-328a-4ce2-9848-cb4066b496c1 req-96cd4bb3-051b-4f6c-8050-febde734707c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058098 Oct 05 14:13:14.981582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 149/290] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:13:15.206603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:15.209276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:15.232538 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:15.233038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:15.233507 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:15.234211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:15.237522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:15.244468 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:15.259868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:15.299534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:15.300260 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:15.314084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:15.314873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:15.315602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:15.316481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:15.317646 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:15.318277 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:15.324139 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:15.539177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:15.569126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8afb292b-bb4e-4002-be69-de50c1f2c40f tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.274091 Oct 05 14:13:15.579304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 150/291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:15 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:15.579304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1652123544", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b437248-26e7-4fec-a6c0-2f104cafa80b"}], "security_groups": [{"name": "tempest-securitygroup--592449258"}], "key_name": "tempest-keypair-598333004", "user_data": "}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:15.676985 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:15.686703 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:15.693821 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:15.695051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e227f82f-131c-4a41-885d-b58cc7760ee5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.493062 Oct 05 14:13:15.698384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 142/292] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:15 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:16.648770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:16.649451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:16.656469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:16.656995 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:16.666184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:16.667845 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:16.668535 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:16.669798 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:16.718401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:16.737918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:16.834298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:16.842797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-999db843-dd89-4f8e-a57d-d3e6deae35df tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.246091 Oct 05 14:13:16.843948 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 143/293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:16 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:16.848891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:16.849748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:16.856680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:16.857168 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:16.860354 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:16.861315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:16.866384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:16.867500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:17.054835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:17.074345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:17.076038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:17.077235 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c6b3e28a-d812-446a-8c92-04bf14fb4ffb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.232282 Oct 05 14:13:17.077787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 144/294] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:16 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:17.146602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] validate_networks() for [('9b437248-26e7-4fec-a6c0-2f104cafa80b', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:13:17.589941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:13:17.590886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:13:17.591549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:13:17.592164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:13:17.592744 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:13:17.602963 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:17.603798 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:17.603923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:17.604642 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:17.605451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:17.606141 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:17.626319 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for project 80b3167e7ad94627b239bf680217ff61. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:13:17.632520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Getting quotas for user 3603342a11f14f3d9edd7dbcbf08d72d and project 80b3167e7ad94627b239bf680217ff61. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:13:17.644821 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:13:17.647437 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:13:17.700522 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f019bd9d-f799-4791-8fa1-489d9dad6014 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.128646 Oct 05 14:13:17.701175 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 151/295] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:13:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:13:17.712719 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b4d1ba39-59fd-4dda-aab7-0da470ad17f3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:17.714516 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b4d1ba39-59fd-4dda-aab7-0da470ad17f3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:17.804428 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b4d1ba39-59fd-4dda-aab7-0da470ad17f3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:17.812278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b4d1ba39-59fd-4dda-aab7-0da470ad17f3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1245 microversion: 2.1 time: 0.103653 Oct 05 14:13:17.827678 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 145/296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:17 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:17.872261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:17.872884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:17.881252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:17.881758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:17.884686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:17.885555 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:17.885991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:17.886429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:18.042585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:18.054401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-179a9736-04d1-4945-a74a-5d2fabaca349 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.184793 Oct 05 14:13:18.069912 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 152/297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:17 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:18.105621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:18.106657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:18.115426 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:18.119449 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:18.119953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:18.120761 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:18.121685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:18.122201 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:18.391035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:18.402249 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:18.404796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:18.408895 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-43aade6f-ebd6-4018-b55e-673fe83a9d6b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.307826 Oct 05 14:13:18.409604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 146/298] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:18 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:18.840036 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:18.840760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:18.851440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:18.851940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:18.852386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:18.853126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:18.867668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:18.868152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:18.966289 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:18.978162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-246fec34-ef68-4364-a1a7-1366841f09f1 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1297 microversion: 2.1 time: 0.146902 Oct 05 14:13:18.989567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 153/299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:18 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:19.080981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:19.081680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:19.099807 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:19.100376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:19.100793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:19.101525 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:19.101986 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:19.102434 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:19.468422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:19.469027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:19.477771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:19.486855 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:19.487364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:19.487914 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:19.488853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:19.489714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:19.490326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:19.505167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1dbf0516-c61d-4336-bbdf-6df035722836 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.428621 Oct 05 14:13:19.537289 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 147/300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:19 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:20.025727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:20.026423 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:20.037206 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:20.037941 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:20.038544 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:20.039423 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:20.040037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:20.040755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:20.155033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:20.170465 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d2d3a1a0-711e-49db-b601-271a72500475 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1303 microversion: 2.1 time: 0.150594 Oct 05 14:13:20.176492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 148/301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:20 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:20.182720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:20.199804 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:20.201758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:20.205299 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bef9e4df-f73d-4a1b-a0c3-b140848c40bf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.746899 Oct 05 14:13:20.209521 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 154/302] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:19 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:20.550270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:20.555410 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:20.581158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:20.588545 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:20.589256 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:20.591428 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:20.595317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:20.596238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:21.050890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:21.062591 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-27cac33b-d428-4048-98ae-f01ed4918928 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.516691 Oct 05 14:13:21.083950 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 149/303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:20 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:21.204633 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:21.206306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:21.217012 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:21.219653 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:21.220521 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:21.221927 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:21.222797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:21.223499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:21.232675 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:21.234904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:21.245519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:21.246033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:21.250461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:21.252474 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:21.256783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:21.257506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:21.564984 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:21.582850 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c0634af9-3271-4400-b0e4-278a1878bff7 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.380164 Oct 05 14:13:21.584064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 155/304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:21 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:21.689987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:21.703650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:21.705112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:21.707612 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e997a88a-760b-4fee-ba57-7b01a90d5e02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.479515 Oct 05 14:13:21.710634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 150/305] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:21 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:22.089414 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:22.090322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:22.099327 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.100643 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.103020 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.103971 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.106267 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.107201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.113873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-34623e35-a78e-4f16-9796-929318388688 req-fac9f3e1-5e78-4e8e-b8c9-d765fd7cab78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c812772a-b68e-43af-aaa3-a872602e897a", "tag": "6c3fa8f2-59b6-418c-ad8b-641bae758166"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:22.128336 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-34623e35-a78e-4f16-9796-929318388688 req-fac9f3e1-5e78-4e8e-b8c9-d765fd7cab78 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.138281 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-34623e35-a78e-4f16-9796-929318388688 req-fac9f3e1-5e78-4e8e-b8c9-d765fd7cab78 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.140475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-34623e35-a78e-4f16-9796-929318388688 req-fac9f3e1-5e78-4e8e-b8c9-d765fd7cab78 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.186848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-34623e35-a78e-4f16-9796-929318388688 req-fac9f3e1-5e78-4e8e-b8c9-d765fd7cab78 service nova] Creating event network-changed:6c3fa8f2-59b6-418c-ad8b-641bae758166 for instance c812772a-b68e-43af-aaa3-a872602e897a on hv-cinder-83587 Oct 05 14:13:22.200437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-34623e35-a78e-4f16-9796-929318388688 req-fac9f3e1-5e78-4e8e-b8c9-d765fd7cab78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089907 Oct 05 14:13:22.206401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 151/306] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:22.336976 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:22.349108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-53fb81bd-3d6c-4589-9481-b9efd450c6a7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.263265 Oct 05 14:13:22.350345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 156/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:22 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:22.614382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:22.615478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:22.632644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.633969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.637928 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.639176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.640011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.640902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.740646 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:22.741888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:22.755039 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.755541 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.755998 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.759996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:22.760661 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:22.763902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:22.964291 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:22.996849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-70913647-10fc-499e-997c-869e63d87b13 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.388093 Oct 05 14:13:22.998119 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 152/308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:22 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:23.026304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:23.047290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:23.047290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:23.047290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-870e749b-18fb-4713-9ae6-5be838805da1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.309883 Oct 05 14:13:23.061519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 157/309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:22 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:23.375333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:23.376273 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:23.390484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:23.391375 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:23.392024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:23.392992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:23.393688 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:23.405975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:23.851222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-0b1baf6f-d6c4-45dc-bbf4-da035a941884 req-e36a8fcd-8c15-4b03-8a6a-b8f72a1a5b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c97bc1-1b97-4fb6-ae36-51f8722ee72a", "name": "network-vif-plugged", "status": "completed", "tag": "efc62756-9332-4108-9df2-4d6ad291baa6"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:23.870649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-0b1baf6f-d6c4-45dc-bbf4-da035a941884 req-e36a8fcd-8c15-4b03-8a6a-b8f72a1a5b37 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:23.871428 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-0b1baf6f-d6c4-45dc-bbf4-da035a941884 req-e36a8fcd-8c15-4b03-8a6a-b8f72a1a5b37 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:23.874213 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-0b1baf6f-d6c4-45dc-bbf4-da035a941884 req-e36a8fcd-8c15-4b03-8a6a-b8f72a1a5b37 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:23.909013 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-0b1baf6f-d6c4-45dc-bbf4-da035a941884 req-e36a8fcd-8c15-4b03-8a6a-b8f72a1a5b37 service nova] Creating event network-vif-plugged:efc62756-9332-4108-9df2-4d6ad291baa6 for instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a on hv-cinder-83587 Oct 05 14:13:23.917338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-0b1baf6f-d6c4-45dc-bbf4-da035a941884 req-e36a8fcd-8c15-4b03-8a6a-b8f72a1a5b37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070124 Oct 05 14:13:23.918631 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 158/310] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:13:24.023347 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:24.024339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:24.032933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:24.042164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:24.043489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:24.044426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:24.045040 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:24.045647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:24.089587 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:24.102523 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bbb17b53-85a3-413d-ac78-42d04bdee50b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.730923 Oct 05 14:13:24.103379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 153/311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:23 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:24.115386 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:24.116267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:24.126466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:24.127127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:24.127723 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:24.128600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:24.129306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:24.129885 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:24.261787 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:24.273637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-34f28da1-9d49-4e27-a230-e1bc5c11b434 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.254875 Oct 05 14:13:24.274426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 159/312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:24 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:24.377888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:24.390870 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:24.393267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:24.395353 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-91a9d6a6-d24c-4df1-aa59-812626fcfb15 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.290881 Oct 05 14:13:24.397054 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 154/313] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:24 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:25.130663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:25.132293 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:25.143889 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:25.144303 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:25.147348 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:25.150381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:25.151026 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:25.151613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:25.302687 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:25.306087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:25.336091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:25.342442 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:25.345933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:25.347122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:25.352101 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:25.352773 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:25.487151 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:25.498178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9874ffb5-d414-44e0-96bb-9fab7b611200 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.372060 Oct 05 14:13:25.499700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 160/314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:25 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:25.507649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:25.514562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:25.525011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:25.526762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:25.530281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:25.531274 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:25.531946 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:25.532577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:25.635824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:25.654064 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d19c1aee-1adf-4505-9a10-56d5dd311946 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.355767 Oct 05 14:13:25.678278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 155/315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:25 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:25.755030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:25.765266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:25.767011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:25.768196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-503571b0-8a39-4835-9071-d8cb807ea21b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.267413 Oct 05 14:13:25.769028 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 161/316] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:25 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:26.526057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:26.527347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:26.534145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:26.535888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:26.536566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:26.537514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:26.538223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:26.539037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:26.680764 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:26.682097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:26.696711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:26.697217 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:26.697690 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:26.698395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:26.698853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:26.699276 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:26.701850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:26.712703 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0273bb7e-5e97-4360-a888-9d207ee597a8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1319 microversion: 2.1 time: 0.190554 Oct 05 14:13:26.728930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 156/317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:26 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:26.796560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:26.797463 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:26.805142 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:26.806371 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:26.806973 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:26.807893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:26.808496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:26.809075 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:26.949915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:26.959688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-229dc389-991a-4502-b450-7c9086ef4042 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.282739 Oct 05 14:13:26.960381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 162/318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:26 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:26.990239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:26.999402 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:27.000890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:27.002446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5e945cfd-63f5-4bfc-b115-d4b23aabe7fc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.210581 Oct 05 14:13:27.003420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 157/319] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:26 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:27.735629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:27.736476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:27.742597 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:27.743441 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=12 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:27.745822 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:27.746708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:27.747307 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:27.748030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:27.748490 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:27.748916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:27.882344 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:27.893003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d64d3bc2-75d9-401d-946b-8140800bc8c8 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1507 microversion: 2.1 time: 0.161247 Oct 05 14:13:27.893790 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 163/320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:27 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:27.984813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:27.985455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:27.987714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:27.995701 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:27.996568 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:27.997016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:27.997765 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:27.998384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:27.998811 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:28.029215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:28.030579 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:28.039291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:28.039935 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:28.040589 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:28.041603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:28.042192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:28.042711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:28.173256 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:28.186214 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7497706c-d683-475f-9992-45fe1eda9dff tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.204565 Oct 05 14:13:28.187086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 158/321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:27 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:28.230503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:28.243850 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:28.245630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:28.247231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-cf7a22e0-0299-4c74-a3c9-9598e3dc155b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1737 microversion: 2.20 time: 0.222710 Oct 05 14:13:28.261417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 164/322] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:28 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:29.215584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:29.216377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:29.223700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:29.224238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:29.224982 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:29.225706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:29.226310 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:29.226742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:29.275753 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:29.277031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:29.285934 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:29.286450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:29.287108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:29.287788 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:29.288631 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:29.288884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:29.376609 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:29.385198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-17e8b1f1-c13a-4cba-80ba-bbc7e1358df8 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.174143 Oct 05 14:13:29.385916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 159/323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:29 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:29.435995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:29.445023 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:29.446526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:29.447724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-455c51cb-ac56-4fbb-bb22-5e9b88c67c74 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1719 microversion: 2.20 time: 0.176857 Oct 05 14:13:29.448295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 165/324] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:29 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:30.407863 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:30.408470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:30.414620 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:30.415104 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:30.415729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:30.416425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:30.416881 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:30.417500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:30.440535 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=100 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:30.475962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:30.476578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:30.483311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:30.483800 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:30.484232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:30.484927 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:30.485415 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:30.486025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:30.582142 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:30.592702 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e8311b2b-f0c4-47c9-99b8-e33aff58e428 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.188098 Oct 05 14:13:30.593848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 160/325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:30 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:30.660355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:30.668371 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:30.669880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:30.671038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1102a251-cdf1-4121-ac78-f7132a1ca88e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1719 microversion: 2.20 time: 0.199015 Oct 05 14:13:30.671771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 166/326] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:30 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:31.650699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:31.652205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:31.666312 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:31.667587 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:31.668760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:31.670560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:31.671660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:31.672734 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:31.701768 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:31.703245 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:31.711507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:31.712351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:31.713009 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:31.713982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:31.714664 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:31.715305 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:31.850752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:31.861116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3343a4a9-eac7-461e-85b2-257b0580f576 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.214992 Oct 05 14:13:31.873684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 161/327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:31 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:31.889561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:31.900151 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:31.901605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:31.903118 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c0798e9b-7343-4e39-b6a1-d268fb836064 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1722 microversion: 2.20 time: 0.206036 Oct 05 14:13:31.904125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 167/328] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:31 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:31.929684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98c2dcb4-4efd-43de-af41-23689788f9e6"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:31.932644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:31.940500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:31.941872 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:31.942571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:31.944791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:31.945575 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:31.946254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:31.997840 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-aff684ee-bb53-40e5-9441-80b5856809c7 req-598947cb-948c-4fd1-a63c-4c4ebf634b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "name": "network-vif-unplugged", "status": "completed", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:32.020003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-aff684ee-bb53-40e5-9441-80b5856809c7 req-598947cb-948c-4fd1-a63c-4c4ebf634b3b service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.021120 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-aff684ee-bb53-40e5-9441-80b5856809c7 req-598947cb-948c-4fd1-a63c-4c4ebf634b3b service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.022208 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-aff684ee-bb53-40e5-9441-80b5856809c7 req-598947cb-948c-4fd1-a63c-4c4ebf634b3b service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:32.028613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:32.044696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-aff684ee-bb53-40e5-9441-80b5856809c7 req-598947cb-948c-4fd1-a63c-4c4ebf634b3b service nova] Creating event network-vif-unplugged:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:13:32.051962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-aff684ee-bb53-40e5-9441-80b5856809c7 req-598947cb-948c-4fd1-a63c-4c4ebf634b3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061629 Oct 05 14:13:32.053173 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 168/329] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:32.617916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b6a3190b-0095-4ae3-b363-09a335772094 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.692228 Oct 05 14:13:32.619579 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 162/330] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 5 14:13:31 2022] POST /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments => generated 188 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:13:32.788750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:32.790172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:32.799245 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.799730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.800368 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:32.801763 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.802185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.802610 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:32.850802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120645) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 14:13:32.886952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:32.888904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:32.896661 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.897664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.898415 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:32.899738 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.901337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.902032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:32.941964 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a02cf79e-8d16-40b6-86a2-8df233684096 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/action" status: 202 len: 0 microversion: 2.20 time: 0.158960 Oct 05 14:13:32.943124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 169/331] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 14:13:32 2022] POST /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:13:32.962640 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:32.963805 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:32.974816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.975515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.976197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:32.977411 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:32.978410 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:32.979101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:33.112358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:33.122216 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ca9017ec-9caa-4657-b142-ab74be8d5e10 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.240450 Oct 05 14:13:33.150729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 163/332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:32 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:33.171700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:33.185931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:33.188220 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:33.190799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5cc94d29-de00-4d51-a5fd-f0e82af146d1 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.235360 Oct 05 14:13:33.194270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 170/333] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:32 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:33.667820 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:33.669779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:33.680050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:33.680916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:33.682038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:33.683395 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:33.684691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:33.685629 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:33.732811 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7ebc0865-9ae7-4604-aa1e-d580044a63aa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/ips" status: 200 len: 150 microversion: 2.1 time: 0.070702 Oct 05 14:13:33.740818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:13:33 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/ips => generated 150 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:34.113088 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-84ffc0f2-c45e-4e89-930a-7422099ea380 req-34df79d7-b38f-48df-b48d-45a9ca818576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812772a-b68e-43af-aaa3-a872602e897a", "name": "network-vif-plugged", "status": "completed", "tag": "6c3fa8f2-59b6-418c-ad8b-641bae758166"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:34.146123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-84ffc0f2-c45e-4e89-930a-7422099ea380 req-34df79d7-b38f-48df-b48d-45a9ca818576 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:34.147475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-84ffc0f2-c45e-4e89-930a-7422099ea380 req-34df79d7-b38f-48df-b48d-45a9ca818576 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:34.149363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-84ffc0f2-c45e-4e89-930a-7422099ea380 req-34df79d7-b38f-48df-b48d-45a9ca818576 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:34.154185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:34.155553 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:34.166783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:34.167408 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:34.167823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:34.168540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:34.169002 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:34.174403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:34.194513 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-84ffc0f2-c45e-4e89-930a-7422099ea380 req-34df79d7-b38f-48df-b48d-45a9ca818576 service nova] Creating event network-vif-plugged:6c3fa8f2-59b6-418c-ad8b-641bae758166 for instance c812772a-b68e-43af-aaa3-a872602e897a on hv-cinder-83587 Oct 05 14:13:34.218814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-84ffc0f2-c45e-4e89-930a-7422099ea380 req-34df79d7-b38f-48df-b48d-45a9ca818576 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108937 Oct 05 14:13:34.228948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 171/335] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:34.254102 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:34.255453 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:34.263860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:34.264701 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:34.265752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:34.266582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:34.267215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:34.267902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:34.436232 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:34.447535 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2a2425fa-797f-44bf-a19c-dfdea8f66cfd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.296990 Oct 05 14:13:34.449253 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 165/336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:34 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:34.505186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:34.517439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:34.519774 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:34.521277 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9b4965ad-3898-4d3e-a2b0-9dacd109c18e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.283185 Oct 05 14:13:34.522538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 172/337] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:34 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:35.382227 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c92304b-820b-4985-8dda-e438276f85b0"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:35.384870 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:35.390783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:35.391476 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:35.392094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:35.392964 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:35.393599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:35.394765 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:35.478903 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:35.479513 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:35.489712 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:35.490208 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:35.490880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:35.491922 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:35.492390 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:35.493079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:35.651966 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:35.664275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dd47b5dd-006c-46db-a0b7-0f53c42fe162 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1370 microversion: 2.1 time: 0.188691 Oct 05 14:13:35.666558 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 173/338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:35 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:35.671335 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:35.671975 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:35.678281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:35.678776 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:35.679210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:35.679923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:35.680368 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:35.680900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:35.760394 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0df4a17e-5ec3-4e08-8755-ee9a102e149b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381996 Oct 05 14:13:35.761337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 166/339] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:13:35 2022] POST /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:35.852335 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:35.864298 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:35.866815 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:35.868362 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-146e5d26-b84d-4800-8c09-648710e0cf22 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.200836 Oct 05 14:13:35.869045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 174/340] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:35 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:36.688559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:36.689302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:36.696697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:36.697369 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:36.697805 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:36.698604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:36.699199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:36.699676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:36.857738 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:36.866290 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6b214d0f-c30f-44b3-9b92-77b02f8c2e90 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1563 microversion: 2.1 time: 0.182876 Oct 05 14:13:36.867145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 167/341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:36 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:36.890769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:36.891322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:36.897394 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:36.899391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:36.905219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:36.905818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:36.906489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:36.907560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:36.908097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:36.908413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:36.909084 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:36.909197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:36.909887 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:36.910520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:36.911228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:36.911910 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:37.013881 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-cfea5d2c-d5f4-43de-b1e8-d9d625d0f871 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127282 Oct 05 14:13:37.022565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:13:36 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:37.084815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:37.093969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:37.095983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:37.097892 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2f7a98e9-ee72-44f8-971e-a86ff5495009 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.206697 Oct 05 14:13:37.099065 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 168/343] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:36 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:38.123721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:38.124972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:38.136915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:38.137464 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:38.137908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:38.138611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:38.148080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:38.148792 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:38.150362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1b29e4a2-42aa-43fc-b3e9-341c156feb7f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: .version_select at 0x7f218ea41e50>, body: {"keypair": {"name": "tempest-keypair-1678816844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsItQQAkiKBgU5L8sMPE4UwcSBaUg36qlT75oGAtINphIEWSX/1yCJFSCy/Z2Qmmhmlrp+gqv53BpKbKZCbG4h+3I1ZRiV19fBu7FLRMZu3/82JjfcOsA8Ja8v75zvqNg=="}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:38.164492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:38.177014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-1b29e4a2-42aa-43fc-b3e9-341c156feb7f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:13:38.181707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-1b29e4a2-42aa-43fc-b3e9-341c156feb7f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:13:38.234550 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1b29e4a2-42aa-43fc-b3e9-341c156feb7f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096498 Oct 05 14:13:38.235800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 169/344] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:13:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:13:38.304144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-ad1ea258-b17d-4890-bd27-829f2b8d1aa5 req-a2f69c4e-68b1-4b7a-9cf8-b0269e29e9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c812772a-b68e-43af-aaa3-a872602e897a", "tag": "6c3fa8f2-59b6-418c-ad8b-641bae758166"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:38.334492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-ad1ea258-b17d-4890-bd27-829f2b8d1aa5 req-a2f69c4e-68b1-4b7a-9cf8-b0269e29e9b9 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:38.337770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-ad1ea258-b17d-4890-bd27-829f2b8d1aa5 req-a2f69c4e-68b1-4b7a-9cf8-b0269e29e9b9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:38.339562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-ad1ea258-b17d-4890-bd27-829f2b8d1aa5 req-a2f69c4e-68b1-4b7a-9cf8-b0269e29e9b9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:38.359322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-ad1ea258-b17d-4890-bd27-829f2b8d1aa5 req-a2f69c4e-68b1-4b7a-9cf8-b0269e29e9b9 service nova] Creating event network-changed:6c3fa8f2-59b6-418c-ad8b-641bae758166 for instance c812772a-b68e-43af-aaa3-a872602e897a on hv-cinder-83587 Oct 05 14:13:38.367351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-ad1ea258-b17d-4890-bd27-829f2b8d1aa5 req-a2f69c4e-68b1-4b7a-9cf8-b0269e29e9b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067745 Oct 05 14:13:38.368655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 170/345] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:38.413469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:38.432126 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:38.438497 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:38.440143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5462b422-0b15-4a75-8787-6efa862df2b2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.320180 Oct 05 14:13:38.447213 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 176/346] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:38 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:39.469619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:39.470323 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:39.480712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:39.481527 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:39.482346 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:39.490571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:39.491092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:39.491796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:39.722992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:39.733519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:39.735915 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:39.737383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-650a1710-ec5a-4c77-a831-05dbe06507c6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.273140 Oct 05 14:13:39.740351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 171/347] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:39 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:40.283123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-481074436", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acdcb2d2-e854-4a1a-88ab-e50e826e09dc"}], "security_groups": [{"name": "tempest-securitygroup--228681705"}], "key_name": "tempest-keypair-1678816844", "user_data": "}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:40.765027 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:40.766840 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:40.776118 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:40.776861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:40.777601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:40.778531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:40.779005 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:40.779439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:41.022338 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:41.031747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:41.033209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:41.035098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a8237fe6-c452-4933-ac9c-da3bc3549562 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.274425 Oct 05 14:13:41.036207 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 172/348] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:40 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:42.065464 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:42.066991 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:42.073322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:42.074032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:42.074478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:42.075184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:42.075647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:42.076071 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:42.282112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:42.296510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:42.297999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:42.299337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3eb01e7e-aa26-47f5-b74f-530ca09b9aa3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.237875 Oct 05 14:13:42.300112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 173/349] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:42 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:43.332373 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:43.333076 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:43.341403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:43.342238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:43.342943 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:43.344010 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:43.344617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:43.345558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:43.543200 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:43.552740 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:43.554770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:43.555944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7c230fa3-b1b1-4a34-8a95-4f2c942af070 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.230640 Oct 05 14:13:43.556983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 174/350] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:43 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:44.469562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] validate_networks() for [('acdcb2d2-e854-4a1a-88ab-e50e826e09dc', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:13:44.586057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:44.586560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:44.592506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:44.592992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:44.593506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:44.594149 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:44.594580 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:44.595000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:44.613855 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:44.673205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:44.795607 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:44.808135 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:44.810601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:44.812307 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e2e08159-93e2-4b5a-ad58-bda49dcf6117 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1748 microversion: 2.20 time: 0.230895 Oct 05 14:13:44.828304 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 175/351] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:44 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1748 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:44.926980 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:13:44.927424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:13:44.927894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:13:44.928302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:13:44.929023 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:13:44.937967 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:44.938417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:44.938843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:44.939596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:44.940038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:44.944422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:44.963667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:13:44.967752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:13:44.978941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:13:44.981263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:13:45.031888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b32ca0e6-7163-4e70-9520-b0b3b0167666 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.752950 Oct 05 14:13:45.032763 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 177/352] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:13:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 4754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:13:45.045463 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-775e5b91-feda-4819-9c04-648a308b8fd6 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:45.046608 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-775e5b91-feda-4819-9c04-648a308b8fd6 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:45.125909 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-775e5b91-feda-4819-9c04-648a308b8fd6 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:45.133790 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-775e5b91-feda-4819-9c04-648a308b8fd6 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1241 microversion: 2.1 time: 0.093463 Oct 05 14:13:45.134418 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 176/353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:45 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:45.849907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:45.851224 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:45.865853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:45.876983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:45.877847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:45.878894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:45.879372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:45.879801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:46.071292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:46.080285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:46.081818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:46.083012 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7b9aaed2-e834-432a-a4f4-465f1da07be7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1750 microversion: 2.20 time: 0.242162 Oct 05 14:13:46.083576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 178/354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:45 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1750 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:46.159932 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:46.163853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:46.177134 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:46.177931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:46.178610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:46.179529 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:46.180217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:46.180859 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:46.257809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:46.274564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-cf52a8d0-98c5-4c23-b9c5-a6ee7fe8783d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1293 microversion: 2.1 time: 0.119417 Oct 05 14:13:46.277276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 177/355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:46 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:47.115080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:47.116260 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:47.122882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:47.123364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:47.123829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:47.124519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:47.124976 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:47.125426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:47.262041 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:47.274603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:47.276361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:47.277654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bab15867-9973-4ee4-8552-a112c6abe0c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.167085 Oct 05 14:13:47.278427 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 179/356] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:47 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:47.303166 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:47.304513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:47.310725 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:47.311378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:47.312121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:47.313020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:47.313647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:47.314347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:47.430405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:47.439095 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5287588c-c3d9-4422-97ce-ab1a295d343e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1299 microversion: 2.1 time: 0.144272 Oct 05 14:13:47.454063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 178/357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:47 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:48.308136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:48.308753 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:48.319067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:48.319914 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:48.320544 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:48.321725 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:48.322219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:48.322645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:48.463143 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:48.463756 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:48.472905 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:48.477838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:48.478380 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:48.478818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:48.479519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:48.479965 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:48.480562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:48.485544 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:48.487418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:48.488713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bca4e9fc-4f95-4526-82bb-bd76e04f790a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.186650 Oct 05 14:13:48.489438 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 180/358] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:48 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:48.822778 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:48.839931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ec3ea3ed-32f3-40ae-b7fe-10a0e24a4eff tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.380615 Oct 05 14:13:48.841144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 179/359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:48 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:49.339293 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-c1824e3c-ca82-4bef-bb90-c44084344d8c req-b54e050a-e8ab-4148-be35-5a39a89da0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245338e3-b9ea-4ad8-909a-79f8f3e917c0", "tag": "ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:49.361258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c1824e3c-ca82-4bef-bb90-c44084344d8c req-b54e050a-e8ab-4148-be35-5a39a89da0dd service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:49.362049 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c1824e3c-ca82-4bef-bb90-c44084344d8c req-b54e050a-e8ab-4148-be35-5a39a89da0dd service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:49.363578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c1824e3c-ca82-4bef-bb90-c44084344d8c req-b54e050a-e8ab-4148-be35-5a39a89da0dd service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:49.398329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-c1824e3c-ca82-4bef-bb90-c44084344d8c req-b54e050a-e8ab-4148-be35-5a39a89da0dd service nova] Creating event network-changed:ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d for instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 on hv-cinder-83587 Oct 05 14:13:49.405067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-c1824e3c-ca82-4bef-bb90-c44084344d8c req-b54e050a-e8ab-4148-be35-5a39a89da0dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075242 Oct 05 14:13:49.406275 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 181/360] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:13:49.516464 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:49.521704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:49.539904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:49.543998 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:49.544816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:49.547095 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:49.547574 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:49.549936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:49.734621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:49.755070 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:49.756659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:49.758060 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-033a32d5-bbf7-4323-aff2-6207a8c4b309 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.245847 Oct 05 14:13:49.773077 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 180/361] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:49 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:49.871972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:49.873201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:49.880483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:49.880898 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:49.881371 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:49.882084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:49.882762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:49.883195 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:50.046426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:50.054995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4c797c55-ddf5-4069-aa3a-f08a575cffa3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.189178 Oct 05 14:13:50.055562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 182/362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:49 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:13:50.341080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc56560f-0565-4d5d-b608-2bc8cc545d13", "device": "/dev/sdb"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:13:50.344034 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:50.350727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:50.351206 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:50.351655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:50.352354 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:50.352814 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:50.353262 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:50.791199 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:50.791884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:50.798622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:50.799181 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:50.799680 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:50.800950 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:50.801511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:50.802002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:50.944772 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:50.955025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:50.956821 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:50.958300 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0414485d-eabc-4dce-8379-17597df1c3cd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.171002 Oct 05 14:13:50.958934 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 183/363] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:50 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:13:51.077750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:51.078312 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:51.084209 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:51.084727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:51.085162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:51.085904 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:51.086334 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:51.086817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:51.227818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:51.235676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7240864e-ecb0-4f03-891e-bfb330b77ff4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.161757 Oct 05 14:13:51.236334 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 184/364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:51 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:51.982829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:51.984259 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:51.992893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:51.992893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:51.992893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:51.993735 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:51.994266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:51.994779 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:52.158758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:52.169204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:52.170791 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:52.171984 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0417897a-b8fc-44f4-a6f5-19f3824053d6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.193136 Oct 05 14:13:52.172550 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 185/365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:51 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:52.260519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:52.261120 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:52.267708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:52.268459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:52.269680 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:52.270657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:52.271309 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:52.271931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:52.408670 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:52.412177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:52.417409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1ae918d6-b806-4f8e-b693-4f9ab45aec02 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.160961 Oct 05 14:13:52.417987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 186/366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:52 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:53.199381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:53.200060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:53.207731 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:53.208214 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:53.208648 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:53.209372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:53.209826 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:53.210261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:53.361968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:53.372412 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:53.374117 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:53.375359 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e6b8d967-5870-4132-8cb2-4f082a8d5028 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.182474 Oct 05 14:13:53.376019 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 187/367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:53 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:53.441652 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:53.442270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:53.448313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:53.448803 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:53.449394 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:53.450017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:53.450392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:53.450833 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:53.624286 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:53.633657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3ce6a709-4171-4c80-a811-b92b9bce6b09 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.196348 Oct 05 14:13:53.635137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 188/368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:53 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:54.400127 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:54.402093 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:54.408694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:54.409170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:54.410160 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:54.411011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:54.411629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:54.412055 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:54.545907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:54.556000 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:54.557478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:54.558637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-826f9f93-10f9-48ff-9626-38c585245164 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.162437 Oct 05 14:13:54.559186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 189/369] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:54 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:54.664498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:54.665193 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:54.672988 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:54.673613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:54.674128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:54.674915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:54.675448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:54.675970 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:54.817938 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:54.825910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1c63e209-1630-4286-b318-013435678c7d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.169372 Oct 05 14:13:54.826587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 190/370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:54 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:55.130785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:55.584209 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:55.584846 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:55.586633 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:55.587386 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=6 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:55.594443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:55.594944 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:55.595387 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:55.596094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:55.596552 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:55.597557 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:55.735955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:55.749346 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:55.750970 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:55.752238 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e4d4723d-ea55-4cae-a6ca-69e1efe23690 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.172566 Oct 05 14:13:55.753061 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 191/371] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:55 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:55.849596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:55.850322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:55.857206 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:55.857803 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:55.858304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:55.859066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:55.859523 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:55.859942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:55.994630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:56.002295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a431944c-fe0f-495f-88c2-3579513f47fa tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.156654 Oct 05 14:13:56.002852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 192/372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:55 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:56.778798 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:56.779477 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:56.787250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:56.787451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:56.787840 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:56.788548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:56.789008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:56.789462 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:56.937877 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:56.946640 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:56.948084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:56.949258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4e291384-2e84-496b-886e-d6148405717e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.174359 Oct 05 14:13:56.949820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 193/373] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:56 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:57.025730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:57.026345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:57.032440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:57.032887 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:57.033347 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:57.034041 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:57.035120 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:57.035508 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:57.176720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:57.184642 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e4a09b61-98b9-4f5a-8e4c-ae4c42bba1ee tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.162674 Oct 05 14:13:57.185435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 194/374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:57 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:57.976079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:57.976794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:57.983041 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:57.983517 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:57.983949 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:57.984628 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:57.985087 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:57.985534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:58.125465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:58.134031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:58.135470 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:58.136608 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e6f756a1-dffa-4e72-852a-a1a77f8975c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.165094 Oct 05 14:13:58.137158 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 195/375] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:57 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:58.207510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:58.208120 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:58.214588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:58.215085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:58.215756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:58.216522 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:58.216984 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:58.217452 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:58.345402 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:58.353538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2a9ec7cc-8d7c-4828-83e2-f4e79b133b22 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.149807 Oct 05 14:13:58.354098 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 196/376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:58 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:13:59.161218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:59.161850 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:59.168132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:59.168611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:59.169044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:59.169743 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:59.170194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:59.170611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:59.296774 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:59.306123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:59.307572 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:59.308719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-906d0520-0012-4c98-8db2-af8f74b95eec tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.151446 Oct 05 14:13:59.309285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 197/377] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:13:59 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:13:59.375605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:13:59.376205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:13:59.382565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:59.383040 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:59.383468 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:59.384142 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:13:59.384590 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:13:59.385008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:13:59.514251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:13:59.521710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ec9d453a-ca5a-4595-b9c2-11c30dc03548 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.149716 Oct 05 14:13:59.522287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 198/378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:13:59 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:00.134775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bf86432f-d2f1-4f9d-8a1e-db184ec9c103 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "POST /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.797667 Oct 05 14:14:00.135623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 181/379] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:13:50 2022] POST /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a/os-volume_attachments => generated 194 bytes in 9799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:00.335462 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:00.336003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:00.342737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:00.343229 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:00.343669 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:00.344363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:00.344832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:00.345718 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:00.481567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:00.492991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:00.494458 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:00.495602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-36796997-4e12-4822-9e4f-fb4115acc0a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.165041 Oct 05 14:14:00.496149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 199/380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:00 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:00.542173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:00.547002 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:00.547698 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:00.555427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:00.555913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:00.556340 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:00.557020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:00.557492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:00.557913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:00.685261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:00.693670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-aea18619-4006-444c-8ac1-d76ecce940cb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.152947 Oct 05 14:14:00.694589 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 182/381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:00 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:01.521252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:01.521880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:01.528339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:01.528826 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:01.529294 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:01.530024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:01.530489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:01.530920 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:01.663038 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:01.671710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:01.673163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:01.674366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-60482470-d081-4b25-901b-35825c98adbf tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.156994 Oct 05 14:14:01.675455 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 200/382] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:01 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:01.716572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:01.717195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:01.724120 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:01.724613 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:01.725050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:01.725847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:01.726315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:01.726746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:01.854433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:01.861976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e11f330e-8aa7-46b3-a446-7935793ba552 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.149366 Oct 05 14:14:01.863188 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 183/383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:01 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:02.700044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:02.700657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:02.706797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:02.707278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:02.707714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:02.708397 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:02.708863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:02.709325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:02.840822 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:02.849988 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:02.851416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:02.852554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4b3865e3-3d7a-4e71-a7be-78abad7d7bdb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.156375 Oct 05 14:14:02.853111 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 201/384] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:02 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:02.884319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:02.884925 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:02.891211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:02.891690 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:02.892119 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:02.892797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:02.893267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:02.894303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:03.021570 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:03.029094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-34a7f0b6-fc99-4b90-b360-52e7c2fd0fcb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.148605 Oct 05 14:14:03.030098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 184/385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:02 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:03.119087 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "bc56560f-0565-4d5d-b608-2bc8cc545d13", "create_info": {"type": "qcow2", "new_file": "volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.4502900a-a7f2-484d-b8bd-013036265dc7.vhdx", "snapshot_id": "4502900a-a7f2-484d-b8bd-013036265dc7"}}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:03.127079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab08cad5-af0f-42a8-b6cc-999af6152333(cell1) {{(pid=120645) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 05 14:14:03.127533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:03.128079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:03.128500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:03.166926 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:03.167514 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:03.167949 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:03.190037 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-87717752-ce47-4c91-8aed-1b548cbe2fcf req-a1711f4a-21a9-416e-a6bc-441fad29b7b7 admin admin] 10.222.0.40 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.189119 Oct 05 14:14:03.191222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 202/386] 10.222.0.40 () {64 vars in 1326 bytes} [Wed Oct 5 14:14:02 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 14:14:03.700244 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-33bc826a-2e67-4a4f-9fdc-079c70915e5f req-589d284e-54ff-4dc1-abb8-8935a225f12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "name": "network-vif-plugged", "status": "completed", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:03.713450 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-33bc826a-2e67-4a4f-9fdc-079c70915e5f req-589d284e-54ff-4dc1-abb8-8935a225f12a service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:03.713940 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-33bc826a-2e67-4a4f-9fdc-079c70915e5f req-589d284e-54ff-4dc1-abb8-8935a225f12a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:03.714372 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-33bc826a-2e67-4a4f-9fdc-079c70915e5f req-589d284e-54ff-4dc1-abb8-8935a225f12a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:03.725251 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-33bc826a-2e67-4a4f-9fdc-079c70915e5f req-589d284e-54ff-4dc1-abb8-8935a225f12a service nova] Creating event network-vif-plugged:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:14:03.729986 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-33bc826a-2e67-4a4f-9fdc-079c70915e5f req-589d284e-54ff-4dc1-abb8-8935a225f12a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034819 Oct 05 14:14:03.730561 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 185/387] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:14:03.879660 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:03.880363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:03.888903 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:03.889426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:03.889870 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:03.890561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:03.891020 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:03.891447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:04.023730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:04.032348 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:04.033820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:04.035476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-12688f8e-7b3d-45c4-b444-9bb93dea8d3f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.161223 Oct 05 14:14:04.036029 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 203/388] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:03 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:04.053486 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:04.054198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:04.060278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:04.060768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:04.061209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:04.061959 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:04.062425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:04.062861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:04.191673 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:04.199246 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-002e2b03-867c-4d3b-9cf1-56e82eecbe49 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.150950 Oct 05 14:14:04.199801 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 186/389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:04 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:05.060931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:05.061827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:05.068327 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:05.068806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:05.069247 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:05.069951 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:05.070400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:05.070817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:05.074903 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:05.206735 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:05.215649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:05.217191 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:05.218479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c2338026-9e08-4e6b-903f-f38258528ee8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.161459 Oct 05 14:14:05.219106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 204/390] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:05 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:05.223221 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:05.224278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:05.231806 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:05.232302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:05.232752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:05.234137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:05.234601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:05.235029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:05.366545 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:05.374044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-23b857c6-9258-44be-93f6-b7a1154e01de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.156088 Oct 05 14:14:05.374606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 187/391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:05 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:06.035570 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "bc56560f-0565-4d5d-b608-2bc8cc545d13", "create_info": {"type": "qcow2", "new_file": "volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.e106d49e-53f9-43b7-85db-6ff4a83aea9d.vhdx", "snapshot_id": "e106d49e-53f9-43b7-85db-6ff4a83aea9d"}}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:06.038937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:06.039415 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:06.039845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:06.047889 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:06.048351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:06.048781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:06.062113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-b40a8b78-5eb2-4fec-9b8f-d138339ed0fd req-cfcde5b6-9835-4db9-8131-6d578f782426 admin admin] 10.222.0.40 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.075933 Oct 05 14:14:06.062685 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 205/392] 10.222.0.40 () {64 vars in 1326 bytes} [Wed Oct 5 14:14:05 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:14:06.244685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:06.245358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:06.251385 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:06.251869 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:06.252304 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:06.252986 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:06.253503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:06.253925 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:06.378480 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:06.386909 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:06.388340 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:06.389512 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-561b56d4-24df-4596-8613-b1854d4f6e09 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.149029 Oct 05 14:14:06.390067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 188/393] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:06 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:06.396604 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:06.397419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:06.403418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:06.403968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:06.404476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:06.405246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:06.405706 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:06.406134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:06.530780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:06.538737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7f10fe82-f752-4e4c-ad8c-eb8c75fb03a3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.146693 Oct 05 14:14:06.539292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 206/394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:06 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:07.415141 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:07.415746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:07.422057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:07.422535 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:07.422964 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:07.423645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:07.424092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:07.424510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:07.561582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:07.562200 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:07.566436 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:07.573841 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:07.574345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:07.574967 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:07.575635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:07.576238 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:07.576671 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:07.579015 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:07.580481 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:07.582268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7af029d3-1c74-4430-8c86-bfdc76ecb2d4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1806 microversion: 2.20 time: 0.170928 Oct 05 14:14:07.585274 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 189/395] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:07 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:07.741018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:07.749727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3c0644b4-0ab0-4c19-85be-3bf21f5b5f72 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.191668 Oct 05 14:14:07.773505 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 207/396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:07 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:07.881880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-30a30367-99f7-4976-a972-7bf6d50beb0d req-071eb27b-35b6-4e5d-a0a8-537c0579fbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245338e3-b9ea-4ad8-909a-79f8f3e917c0", "name": "network-vif-plugged", "status": "completed", "tag": "ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:07.892977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-30a30367-99f7-4976-a972-7bf6d50beb0d req-071eb27b-35b6-4e5d-a0a8-537c0579fbce service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:07.894224 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-30a30367-99f7-4976-a972-7bf6d50beb0d req-071eb27b-35b6-4e5d-a0a8-537c0579fbce service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:07.894658 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-30a30367-99f7-4976-a972-7bf6d50beb0d req-071eb27b-35b6-4e5d-a0a8-537c0579fbce service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:07.905843 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-30a30367-99f7-4976-a972-7bf6d50beb0d req-071eb27b-35b6-4e5d-a0a8-537c0579fbce service nova] Creating event network-vif-plugged:ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d for instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 on hv-cinder-83587 Oct 05 14:14:07.910912 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-30a30367-99f7-4976-a972-7bf6d50beb0d req-071eb27b-35b6-4e5d-a0a8-537c0579fbce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 Oct 05 14:14:07.911495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 190/397] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:08.608331 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:08.608933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:08.615828 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:08.616555 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:08.616982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:08.617691 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:08.618139 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:08.618555 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:08.749877 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:08.758404 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:08.759849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:08.760991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a8bb0d62-f0fb-4794-a6ed-bb3974f2c9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1793 microversion: 2.20 time: 0.156576 Oct 05 14:14:08.761577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 208/398] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:08 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1793 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:08.780143 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:08.780860 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:08.788121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:08.788608 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:08.789077 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:08.789762 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:08.790219 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:08.790647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:08.925761 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:08.933562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0d9c8aff-a28a-4e73-b01f-b88772010777 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.157806 Oct 05 14:14:08.934204 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 191/399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:08 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:09.260586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "bc56560f-0565-4d5d-b608-2bc8cc545d13", "create_info": {"type": "qcow2", "new_file": "volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.520b6a1b-5318-4e87-a3f9-f02ca96549c6.vhdx", "snapshot_id": "520b6a1b-5318-4e87-a3f9-f02ca96549c6"}}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:09.263883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:09.264366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:09.264797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:09.273554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:09.274018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:09.274450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:09.287305 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-5cf1b761-cd9f-4ee0-ad02-8ecb7af29a89 req-61a592d7-ab1c-49ba-ab20-6d277861f01e admin admin] 10.222.0.40 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.075133 Oct 05 14:14:09.287881 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 209/400] 10.222.0.40 () {64 vars in 1326 bytes} [Wed Oct 5 14:14:09 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:14:09.956717 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:09.957466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:09.963743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:09.964222 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:09.964656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:09.965362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:09.965815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:09.966237 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:10.096764 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:10.106260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:10.111226 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-81ba6478-c6f2-4b40-9a56-0c90a37591d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1366 microversion: 2.1 time: 0.158870 Oct 05 14:14:10.111902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 192/401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:09 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:11.135563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:11.136262 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:11.142361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:11.142851 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:11.143294 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:11.143985 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:11.144444 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:11.144873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:11.275612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:11.283299 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0915ab5e-38ec-4a81-a16f-0af42b328c08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1556 microversion: 2.1 time: 0.152478 Oct 05 14:14:11.283858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 210/402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:11 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:11.306364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:11.306856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:11.314185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:11.314670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:11.315100 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:11.315788 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:11.316303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:11.316716 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:11.395743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c249f815-8244-45a8-8b4b-9e5e2e577fa5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092581 Oct 05 14:14:11.396347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 193/403] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:14:11 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:12.304364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-c2198658-6aca-4553-8b3f-5b6bb710a3f3 req-ec0e38e2-e739-4dc7-a8f2-2a61123cab0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245338e3-b9ea-4ad8-909a-79f8f3e917c0", "tag": "ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:12.315133 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c2198658-6aca-4553-8b3f-5b6bb710a3f3 req-ec0e38e2-e739-4dc7-a8f2-2a61123cab0f service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:12.315611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c2198658-6aca-4553-8b3f-5b6bb710a3f3 req-ec0e38e2-e739-4dc7-a8f2-2a61123cab0f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:12.316039 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c2198658-6aca-4553-8b3f-5b6bb710a3f3 req-ec0e38e2-e739-4dc7-a8f2-2a61123cab0f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:12.330965 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-c2198658-6aca-4553-8b3f-5b6bb710a3f3 req-ec0e38e2-e739-4dc7-a8f2-2a61123cab0f service nova] Creating event network-changed:ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d for instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 on hv-cinder-83587 Oct 05 14:14:12.336005 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-c2198658-6aca-4553-8b3f-5b6bb710a3f3 req-ec0e38e2-e739-4dc7-a8f2-2a61123cab0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035912 Oct 05 14:14:12.336993 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 211/404] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:12.365373 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:12.374164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ab08cad5-af0f-42a8-b6cc-999af6152333(cell1) {{(pid=120646) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 05 14:14:12.374920 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:12.375474 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:12.376098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:12.417259 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:12.417752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:12.418182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:12.443006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-1354ba56-993e-40a3-b133-45f0c92dcf7e req-3ea77c39-4291-486f-b1f0-2a8c4e78d1a6 admin admin] 10.222.0.40 "DELETE /compute/v2.1/os-assisted-volume-snapshots/4502900a-a7f2-484d-b8bd-013036265dc7?delete_info=%7B%22file_to_merge%22:%20%22volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.4502900a-a7f2-484d-b8bd-013036265dc7.vhdx%22,%20%22volume_id%22:%20%22bc56560f-0565-4d5d-b608-2bc8cc545d13%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.141256 Oct 05 14:14:12.443750 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 194/405] 10.222.0.40 () {62 vars in 1800 bytes} [Wed Oct 5 14:14:12 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/4502900a-a7f2-484d-b8bd-013036265dc7?delete_info=%7B%22file_to_merge%22:%20%22volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.4502900a-a7f2-484d-b8bd-013036265dc7.vhdx%22,%20%22volume_id%22:%20%22bc56560f-0565-4d5d-b608-2bc8cc545d13%22%7D => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:14:15.553788 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:15.557034 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:15.557531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:15.557957 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:15.565981 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:15.566440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:15.566863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:15.580098 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-98863cb6-22df-431b-8691-7766a6c8cd71 req-a654b452-365d-498e-9c41-5e02eff0aca2 admin admin] 10.222.0.40 "DELETE /compute/v2.1/os-assisted-volume-snapshots/520b6a1b-5318-4e87-a3f9-f02ca96549c6?delete_info=%7B%22file_to_merge%22:%20%22volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.520b6a1b-5318-4e87-a3f9-f02ca96549c6.vhdx%22,%20%22volume_id%22:%20%22bc56560f-0565-4d5d-b608-2bc8cc545d13%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.076136 Oct 05 14:14:15.580586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 212/406] 10.222.0.40 () {62 vars in 1800 bytes} [Wed Oct 5 14:14:15 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/520b6a1b-5318-4e87-a3f9-f02ca96549c6?delete_info=%7B%22file_to_merge%22:%20%22volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.520b6a1b-5318-4e87-a3f9-f02ca96549c6.vhdx%22,%20%22volume_id%22:%20%22bc56560f-0565-4d5d-b608-2bc8cc545d13%22%7D => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:14:18.695622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:18.698962 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:18.699432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:18.699862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:18.711016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:18.711016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:18.711262 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:18.726619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-7c2152c4-f003-4982-ac01-2fc34e4399d0 req-e3fc3072-47b5-4e3c-9f70-0d9eed23933e admin admin] 10.222.0.40 "DELETE /compute/v2.1/os-assisted-volume-snapshots/e106d49e-53f9-43b7-85db-6ff4a83aea9d?delete_info=%7B%22file_to_merge%22:%20%22volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.e106d49e-53f9-43b7-85db-6ff4a83aea9d.vhdx%22,%20%22volume_id%22:%20%22bc56560f-0565-4d5d-b608-2bc8cc545d13%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.083327 Oct 05 14:14:18.727647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 195/407] 10.222.0.40 () {62 vars in 1800 bytes} [Wed Oct 5 14:14:18 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/e106d49e-53f9-43b7-85db-6ff4a83aea9d?delete_info=%7B%22file_to_merge%22:%20%22volume-bc56560f-0565-4d5d-b608-2bc8cc545d13.e106d49e-53f9-43b7-85db-6ff4a83aea9d.vhdx%22,%20%22volume_id%22:%20%22bc56560f-0565-4d5d-b608-2bc8cc545d13%22%7D => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:14:21.671700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:21.672284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:21.674189 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:21.680133 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:21.680611 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:21.681053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:21.681768 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:21.682226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:21.682652 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:21.807381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lazy-loading 'services' on Instance uuid e2c97bc1-1b97-4fb6-ae36-51f8722ee72a {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:21.917917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-25c480c9-df7c-4cf4-9def-9d8bbc46536e tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a/os-volume_attachments/bc56560f-0565-4d5d-b608-2bc8cc545d13" status: 202 len: 0 microversion: 2.1 time: 0.250852 Oct 05 14:14:21.918658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 213/408] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:14:21 2022] DELETE /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a/os-volume_attachments/bc56560f-0565-4d5d-b608-2bc8cc545d13 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:14:23.040984 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:23.041524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:23.043878 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=26 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:23.049472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:23.049950 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:23.050384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:23.051063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:23.051513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:23.051968 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:23.076108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:14:23.149345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-686ffcc5-4035-4de8-9b21-0d08977d2174 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 204 len: 0 microversion: 2.1 time: 0.112891 Oct 05 14:14:23.149972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 196/409] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:14:23 2022] DELETE /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:14:23.159931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:23.160627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:23.167876 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:23.168356 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:23.168843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:23.169550 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:23.170001 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:23.170419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:23.302403 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:23.310146 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-69c94544-355a-4211-be52-c0c531cba11a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1513 microversion: 2.1 time: 0.155266 Oct 05 14:14:23.310695 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 214/410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:23 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:23.479105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db01041f-b6f1-4976-83a0-c890895b06da"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:23.481520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:23.487349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:23.487819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:23.488249 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:23.488927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:23.489405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:23.489823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:24.333053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:24.333696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:24.340102 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:24.340589 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:24.341030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:24.341760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:24.342223 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:24.342649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:24.470643 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:24.478796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4ee3e8a7-35df-4e9e-94ca-8e78f36060bc tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1513 microversion: 2.1 time: 0.149602 Oct 05 14:14:24.479362 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 215/411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:24 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:25.502197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:25.502865 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:25.509667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:25.510143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:25.510575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:25.511249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:25.511700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:25.512118 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:25.561761 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=8 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:25.639301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:25.649359 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-98dc5cad-c568-473d-85fd-0ffc17fcd49a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1513 microversion: 2.1 time: 0.150917 Oct 05 14:14:25.649950 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 216/412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:25 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:26.673948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:26.674670 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:26.681615 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:26.682098 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:26.682535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:26.683220 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:26.683675 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:26.684100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:26.810260 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:26.818199 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8ace07bd-1344-4dec-8345-e51ab50dd5d1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1513 microversion: 2.1 time: 0.148105 Oct 05 14:14:26.818773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 217/413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:26 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:27.840806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:27.841454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:27.847737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:27.848215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:27.849150 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:27.849860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:27.850314 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:27.850734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:27.976119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:27.983512 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1820b94c-fac9-4395-aa92-ec7cd6c5a780 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1513 microversion: 2.1 time: 0.146526 Oct 05 14:14:27.984071 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 218/414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:27 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:28.635726 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-812bd414-0a82-4e0b-a602-e6881f5bca52 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.160756 Oct 05 14:14:28.636882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 197/415] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:14:23 2022] POST /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments => generated 194 bytes in 5163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:29.007818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:29.009119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:29.016160 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:29.017025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:29.017499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:29.018202 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:29.018662 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:29.019211 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:29.154616 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:29.162740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c68faa90-9e29-4d24-9114-62bf675a60b9 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1513 microversion: 2.1 time: 0.159456 Oct 05 14:14:29.163310 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=4 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:29.163426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 219/416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:29 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:29.167870 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-4685d8cf-83c1-4b38-8318-8bdc3338613d req-07ca7e3d-2984-45b4-a79a-831832161e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c97bc1-1b97-4fb6-ae36-51f8722ee72a", "name": "network-vif-deleted", "tag": "efc62756-9332-4108-9df2-4d6ad291baa6"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:29.178980 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-4685d8cf-83c1-4b38-8318-8bdc3338613d req-07ca7e3d-2984-45b4-a79a-831832161e25 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:29.179459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-4685d8cf-83c1-4b38-8318-8bdc3338613d req-07ca7e3d-2984-45b4-a79a-831832161e25 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:29.179892 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-4685d8cf-83c1-4b38-8318-8bdc3338613d req-07ca7e3d-2984-45b4-a79a-831832161e25 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:29.190016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-4685d8cf-83c1-4b38-8318-8bdc3338613d req-07ca7e3d-2984-45b4-a79a-831832161e25 service nova] Creating event network-vif-deleted:efc62756-9332-4108-9df2-4d6ad291baa6 for instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a on hv-cinder-83587 Oct 05 14:14:29.195380 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-4685d8cf-83c1-4b38-8318-8bdc3338613d req-07ca7e3d-2984-45b4-a79a-831832161e25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033331 Oct 05 14:14:29.195956 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 198/417] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:14:30.186977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:30.187733 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:30.194338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:30.194827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:30.195343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:30.195974 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:30.196434 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:30.196862 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:30.231429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:30.232163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:30.232699 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:30.233180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lazy-loading 'fault' on Instance uuid e2c97bc1-1b97-4fb6-ae36-51f8722ee72a {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:30.275483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:30.283094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dc8b19c1-9acf-4ecc-a9a8-f2c143c6cc1b tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 200 len: 1309 microversion: 2.1 time: 0.100988 Oct 05 14:14:30.283668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 220/418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:30 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:30.896847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:30.899165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:30.905275 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:30.905760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:30.906195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:30.906884 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:30.907341 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:30.907764 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:30.932514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lazy-loading 'flavor' on Instance uuid c812772a-b68e-43af-aaa3-a872602e897a {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:31.057930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e17241a8-ff93-4d0d-86ee-96b52c6e3de0 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/action" status: 200 len: 32 microversion: 2.1 time: 0.165868 Oct 05 14:14:31.058549 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 199/419] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:14:30 2022] POST /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 14:14:31.067742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:31.068366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:31.075080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:31.075661 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:31.076210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:31.077022 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:31.077527 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:31.077955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:31.208961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:31.217509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-088703f1-b23f-4dc9-8e0a-783ec711b583 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.153447 Oct 05 14:14:31.218065 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 221/420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:31 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:31.307390 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:31.308086 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: e2c97bc1-1b97-4fb6-ae36-51f8722ee72a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:31.314122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:31.314596 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:31.315023 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:31.315703 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:31.316152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:31.316567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:31.332623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] HTTP exception thrown: Instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a could not be found. Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Request method failure captured: Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a HTTP/1.1 Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDwTxZ-LCzabxsvd-Hx9ztUt4d3VPSKzosksLv11J5etpPXKp081ry8T0ghKx655kF1oXTshrPxFG-ISPJeung3gNh6K5DbzsfgLBiVOZ_8p8YRl0eT1wn__aGEHxmmcDJXBix3JlwqPWGlwM_AOxLJEeLacUJ_Ae4Odwaq-86PbVw Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: c5e576ffa90d4118991edb48723664dc Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1709654720 Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:14:31.334272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5e576ffa90d4118991edb48723664dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5e576ffa90d4118991edb48723664dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5e576ffa90d4118991edb48723664dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5e576ffa90d4118991edb48723664dc"}]}] Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesSnapshotTestJSON-1709654720 Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: c5e576ffa90d4118991edb48723664dc Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1709654720 Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesSnapshotTestJSON-1709654720-project Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5da7a95f6608401ab05b1dcf8767aa0f Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesSnapshotTestJSON-1709654720-project Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a could not be found. Oct 05 14:14:31.335787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'e2c97bc1-1b97-4fb6-ae36-51f8722ee72a'} Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a could not be found. Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:14:31.336842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a could not be found. Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a could not be found. Oct 05 14:14:31.338247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:31.339383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Returning 404 to user: Instance e2c97bc1-1b97-4fb6-ae36-51f8722ee72a could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:14:31.339383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-43bf0e55-9780-4429-9593-7d4b0852d5e6 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a" status: 404 len: 111 microversion: 2.1 time: 0.033480 Oct 05 14:14:31.339383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 200/421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:31 2022] GET /compute/v2.1/servers/e2c97bc1-1b97-4fb6-ae36-51f8722ee72a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:14:32.240236 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:32.241100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:32.247270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:32.247750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:32.248183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:32.248900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:32.249382 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:32.249802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:32.267017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:32.378469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:32.387062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f0b0f64d-0cc8-4f37-aae1-1edfadfe7a8f tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.150640 Oct 05 14:14:32.387625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 222/422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:32 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:33.410370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:33.410883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:33.417755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:33.418228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:33.418664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:33.419334 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:33.419784 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:33.420199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:33.546630 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:33.556106 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ab106a49-34d7-4e13-8750-b894bb600da4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.149628 Oct 05 14:14:33.556654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 201/423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:33 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:34.580858 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:34.581496 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:34.587746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:34.588219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:34.588647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:34.589353 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:34.589799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:34.590215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:34.715281 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:34.723387 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8d15e294-63cb-4c18-b552-6cac76f4a128 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.147401 Oct 05 14:14:34.723952 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 223/424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:34 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:35.050744 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1493198062", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "networks": [{"uuid": "c0fdcd54-dc16-4bfa-83d9-972ce821061b"}]}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:35.103636 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] validate_networks() for [('c0fdcd54-dc16-4bfa-83d9-972ce821061b', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:14:35.684198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:14:35.684616 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:14:35.685113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:14:35.685660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:14:35.686070 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:14:35.695982 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:35.696475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:35.696900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:35.697646 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:35.698098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:35.698514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:35.717461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Getting quotas for project c5e576ffa90d4118991edb48723664dc. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:14:35.721566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Getting quotas for user 5da7a95f6608401ab05b1dcf8767aa0f and project c5e576ffa90d4118991edb48723664dc. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:14:35.733805 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:14:35.736164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:14:35.747149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:35.748096 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:35.754655 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:35.755137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:35.755571 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:35.756260 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:35.756712 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:35.757134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:35.788415 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-db5cbe90-c767-43c2-8a51-a8cd953c6138 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740841 Oct 05 14:14:35.789184 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 202/425] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:14:35.799781 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-260def1b-8010-485f-9d26-261a4c963bb0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:35.800394 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-260def1b-8010-485f-9d26-261a4c963bb0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:35.858065 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-260def1b-8010-485f-9d26-261a4c963bb0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:35.867301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-260def1b-8010-485f-9d26-261a4c963bb0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1219 microversion: 2.1 time: 0.071112 Oct 05 14:14:35.867861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 203/426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:35 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:35.908547 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:35.916952 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3d3047e9-e388-4eee-ad7d-e87e1fb976fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.173656 Oct 05 14:14:35.917548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 224/427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:35 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:36.891064 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:36.891604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:36.898716 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:36.899203 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:36.899784 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:36.900343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:36.900794 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:36.901218 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:36.939762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:36.940593 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:36.954418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:36.955330 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:36.955960 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:36.956668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:36.957121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:36.959135 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:36.976418 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:36.984185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-73fa0faf-7ffa-45d7-b119-a79823db4731 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1271 microversion: 2.1 time: 0.096956 Oct 05 14:14:36.989404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 204/428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:36 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:37.108499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:37.117930 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0b3fd1a2-2b86-40ae-b924-9c8644c409ea tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.181949 Oct 05 14:14:37.118505 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 225/429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:36 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:38.007244 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:38.007861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:38.014484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:38.014970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:38.015409 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:38.016113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:38.016570 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:38.017004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:38.141783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:38.142954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:38.150465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:38.150983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:38.151424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:38.152137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:38.152594 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:38.153020 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:38.228357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:38.238127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e0576b61-560b-4738-a3f2-970106e1abe0 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.234768 Oct 05 14:14:38.238785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 205/430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:38 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:38.284655 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:38.293520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d906416b-bf14-4183-98c3-e89f9586cd34 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.155596 Oct 05 14:14:38.294096 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 226/431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:38 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:38.362734 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-6ed28004-05cb-4779-af9c-f6ff9185bfa0 req-0ec0ca0a-24b0-44e6-a16f-8d0e16a9a7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2a03a2-b8e4-40e1-be24-d9026cc4c749", "tag": "8a2efeaf-7ff0-4faa-a18d-89836825886d"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:38.372793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-6ed28004-05cb-4779-af9c-f6ff9185bfa0 req-0ec0ca0a-24b0-44e6-a16f-8d0e16a9a7eb service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:38.373307 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-6ed28004-05cb-4779-af9c-f6ff9185bfa0 req-0ec0ca0a-24b0-44e6-a16f-8d0e16a9a7eb service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:38.373744 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-6ed28004-05cb-4779-af9c-f6ff9185bfa0 req-0ec0ca0a-24b0-44e6-a16f-8d0e16a9a7eb service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:38.386894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-6ed28004-05cb-4779-af9c-f6ff9185bfa0 req-0ec0ca0a-24b0-44e6-a16f-8d0e16a9a7eb service nova] Creating event network-changed:8a2efeaf-7ff0-4faa-a18d-89836825886d for instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 on hv-cinder-83587 Oct 05 14:14:38.391657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-6ed28004-05cb-4779-af9c-f6ff9185bfa0 req-0ec0ca0a-24b0-44e6-a16f-8d0e16a9a7eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 Oct 05 14:14:38.392253 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 206/432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:39.261901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:39.262535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:39.268807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:39.269308 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:39.269746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:39.270423 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:39.270871 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:39.271289 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:39.316897 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:39.317617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:39.323615 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:39.324093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:39.324530 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:39.325216 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:39.325686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:39.326109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:39.397369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:39.405123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8709e620-8993-4026-ba4a-8b156a847568 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.147034 Oct 05 14:14:39.405898 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 227/433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:39 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:39.454684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:39.463446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a5b46678-c091-464d-b3fb-4d0fb87f82a2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.151315 Oct 05 14:14:39.463999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 207/434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:39 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:40.428430 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:40.428963 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:40.435288 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:40.435770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:40.436197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:40.436874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:40.437352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:40.437771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:40.486913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:40.487526 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:40.494582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:40.495065 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:40.495503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:40.496191 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:40.496655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:40.497079 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:40.568563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:40.576346 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ad1a975e-66a4-467e-9cdb-efaef618bd81 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.152292 Oct 05 14:14:40.576912 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 228/435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:40 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:40.623405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:40.631498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d84b3984-4b5f-4971-b681-7f9305a5953d tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.148412 Oct 05 14:14:40.632052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 208/436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:40 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:41.598916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:41.599521 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:41.605922 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:41.606396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:41.606823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:41.607500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:41.607948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:41.608363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:41.654658 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:41.655265 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:41.661811 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:41.662300 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:41.662736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:41.663427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:41.663884 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:41.664308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:41.668401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:41.746166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:41.753961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3ade7e89-a1bc-4f66-953b-bc4d3ca8a126 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.158810 Oct 05 14:14:41.754872 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 229/437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:41 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:41.804795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:41.813822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c519bdf9-ad9e-4875-9056-a2fd00e8f51b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.162708 Oct 05 14:14:41.815368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 209/438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:41 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:42.778030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:42.778623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:42.785047 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:42.785590 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:42.786027 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:42.786714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:42.787757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:42.788190 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:42.839268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:42.839873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:42.846268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:42.846751 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:42.847183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:42.847867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:42.848308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:42.848733 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:42.914461 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:42.922098 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4aca25b4-7918-4069-8188-2a38def4cb6a tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.147881 Oct 05 14:14:42.922671 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 230/439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:42 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:42.975963 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:42.984166 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0cf76e68-9845-4707-91a7-58d5b0a91dce tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.148706 Oct 05 14:14:42.984725 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 210/440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:42 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:43.839968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-c1a1bfe0-fa70-4f9e-9bec-aa3427078bc8 req-2285d181-e2f7-414d-92fa-5decffc57e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2a03a2-b8e4-40e1-be24-d9026cc4c749", "name": "network-vif-plugged", "status": "completed", "tag": "8a2efeaf-7ff0-4faa-a18d-89836825886d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:43.851023 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c1a1bfe0-fa70-4f9e-9bec-aa3427078bc8 req-2285d181-e2f7-414d-92fa-5decffc57e99 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:43.851520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c1a1bfe0-fa70-4f9e-9bec-aa3427078bc8 req-2285d181-e2f7-414d-92fa-5decffc57e99 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:43.851955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-c1a1bfe0-fa70-4f9e-9bec-aa3427078bc8 req-2285d181-e2f7-414d-92fa-5decffc57e99 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:43.863576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-c1a1bfe0-fa70-4f9e-9bec-aa3427078bc8 req-2285d181-e2f7-414d-92fa-5decffc57e99 service nova] Creating event network-vif-plugged:8a2efeaf-7ff0-4faa-a18d-89836825886d for instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 on hv-cinder-83587 Oct 05 14:14:43.868912 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-c1a1bfe0-fa70-4f9e-9bec-aa3427078bc8 req-2285d181-e2f7-414d-92fa-5decffc57e99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Oct 05 14:14:43.869971 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 231/441] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:43.944409 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:43.945018 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:43.951425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:43.951935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:43.952369 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:43.953057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:43.953541 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:43.953966 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:44.007723 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:44.008419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:44.014577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:44.015058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:44.015493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:44.016176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:44.016663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:44.017048 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:44.084822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:44.092519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-861dd08a-a393-44b6-9303-d60cbf0bdf61 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.152456 Oct 05 14:14:44.092950 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 211/442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:43 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:44.146318 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:44.154939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3b9d8443-cf3a-42c4-98dc-295fbf0a5cb5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1734 microversion: 2.1 time: 0.151936 Oct 05 14:14:44.155543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 232/443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:44 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:45.114755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:45.116090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:45.122529 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.123007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.123444 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.124148 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.124583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.125006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.180504 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:45.181249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:45.188004 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.188901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.189438 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.190142 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.191299 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.191729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.262816 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:45.270413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-08aadf39-3ce1-40e2-83d9-01d9776daadb tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.159595 Oct 05 14:14:45.270972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 212/444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:45 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:45.323720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:45.331793 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2617bfba-2ef0-4830-a3f8-2d75fc067164 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1714 microversion: 2.1 time: 0.157276 Oct 05 14:14:45.332351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 233/445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:45 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:45.440466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:45.440968 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:45.446774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.447254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.447687 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.448371 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.448828 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.449270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.589761 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] HTTP exception thrown: Cannot 'detach_volume' instance c812772a-b68e-43af-aaa3-a872602e897a while it is in vm_state rescued Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Request method failure captured: Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments/db01041f-b6f1-4976-83a0-c890895b06da HTTP/1.1 Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRux-cKlIsxHKons3jlj0EpYl9iCLTi9S7g_IXsvjrHcrmAK46phOyhwRGv2I7BCeQRR7k5N-vvFQE1scj3zB5fAJ3t_ZulRsNuz2kG7wgoJsNs68G5BAtD_noYNMI2xtnnfkpEfKxpi87AFC1_B5xPt2ltW-CVHk934q0iVaxtvg Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:14:45.591343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80b3167e7ad94627b239bf680217ff61"}]}] Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 3603342a11f14f3d9edd7dbcbf08d72d Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:14:45.592847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Cannot 'detach_volume' instance c812772a-b68e-43af-aaa3-a872602e897a while it is in vm_state rescued Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'server_id': 'c812772a-b68e-43af-aaa3-a872602e897a', 'id': 'db01041f-b6f1-4976-83a0-c890895b06da'} Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c812772a-b68e-43af-aaa3-a872602e897a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:14:45.593856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c812772a-b68e-43af-aaa3-a872602e897a while it is in vm_state rescued Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c812772a-b68e-43af-aaa3-a872602e897a while it is in vm_state rescued Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:45.595337 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Returning 409 to user: Cannot 'detach_volume' instance c812772a-b68e-43af-aaa3-a872602e897a while it is in vm_state rescued {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:14:45.596540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f83e28a3-1982-4905-bc55-d80a56fe33e2 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments/db01041f-b6f1-4976-83a0-c890895b06da" status: 409 len: 152 microversion: 2.1 time: 0.156263 Oct 05 14:14:45.596540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 213/446] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:14:45 2022] DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments/db01041f-b6f1-4976-83a0-c890895b06da => generated 152 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 14:14:45.602194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:45.602754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:45.608935 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.609454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.609894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.610580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.611034 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.611459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.674173 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-32a8ca9f-dca1-44b3-90e0-34c6fa6c3d9b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "POST /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/action" status: 202 len: 0 microversion: 2.1 time: 0.076150 Oct 05 14:14:45.677263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 234/447] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:14:45 2022] POST /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 14:14:45.682756 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:45.683357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:45.690194 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.690842 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.691286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.691975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:45.692527 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:45.693039 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:45.707904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:45.862130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=8 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:45.911981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:45.923286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3f201d8a-aa82-47ce-85ea-03d7dee7e5bf tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1722 microversion: 2.1 time: 0.244263 Oct 05 14:14:45.923886 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 214/448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:45 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:46.293619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:46.294311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:46.300835 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:46.301342 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:46.301778 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:46.302534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:46.303492 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:46.303909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:46.441767 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:46.451136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e04ae932-2a07-447d-91c6-14ccfc241049 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1319 microversion: 2.1 time: 0.162228 Oct 05 14:14:46.451711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 235/449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:46 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:46.949876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:46.950400 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:46.956900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:46.957422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:46.957860 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:46.958598 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:46.959082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:46.959481 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:47.096961 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:47.105285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b35a4cfc-60df-4c02-9d21-21ae5618b372 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1722 microversion: 2.1 time: 0.162202 Oct 05 14:14:47.105856 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 215/450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:46 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:47.477669 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:47.478359 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:47.484760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:47.485266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:47.485702 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:47.486385 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:47.486839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:47.487263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:47.821897 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:47.829417 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-594bace1-726e-4f58-8be6-b6122e4df510 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1507 microversion: 2.1 time: 0.356106 Oct 05 14:14:47.829979 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 236/451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:47 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:47.853025 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "514d616b-3771-43cf-8a67-f87caf04fed7", "device": "/dev/sdb"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:47.855566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:47.861495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:47.861979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:47.862415 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:47.863100 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:47.863556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:47.863978 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.129155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:48.129719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:48.136033 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.136521 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.136962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.137687 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.138149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.138694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.275419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:48.283658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4abf851f-73ca-4c8a-b35f-b6362d61fd68 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1722 microversion: 2.1 time: 0.158422 Oct 05 14:14:48.289291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 237/452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:48 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:48.289475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:48.289829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:48.295625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.296111 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.296546 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.297361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.297779 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.298205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.324498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:48.329216 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fabcc628-db26-4b0f-bb2e-192f13dac051 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments/98c2dcb4-4efd-43de-af41-23689788f9e6" status: 200 len: 194 microversion: 2.20 time: 0.043867 Oct 05 14:14:48.330144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 238/453] 10.222.0.16 () {60 vars in 1454 bytes} [Wed Oct 5 14:14:48 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments/98c2dcb4-4efd-43de-af41-23689788f9e6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:14:48.397502 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c63f7a1b-6212-4e7b-beb5-107c30221078 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "POST /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548228 Oct 05 14:14:48.398100 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 216/454] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:14:47 2022] POST /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:48.402694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:48.403192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:48.409505 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.409989 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.410422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.411109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.411632 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.412010 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.499105 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lazy-loading 'services' on Instance uuid 8a20e784-a0e0-498b-b35e-698c29824ce3 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:48.571958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-717fa8bb-160e-4ad3-b41b-5c34503867d2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments/98c2dcb4-4efd-43de-af41-23689788f9e6" status: 202 len: 0 microversion: 2.20 time: 0.173665 Oct 05 14:14:48.572541 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 239/455] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 5 14:14:48 2022] DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments/98c2dcb4-4efd-43de-af41-23689788f9e6 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:14:48.581934 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:48.584283 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:48.590372 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.590860 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.591304 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.591992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:48.592467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:48.592877 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:48.625422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-11959b55-6107-4e4a-a4d6-02628d6be3ce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048251 Oct 05 14:14:48.626014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 217/456] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 14:14:48 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:14:49.310938 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:49.311649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:49.317824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:49.318890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:49.319325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:49.320011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:49.320458 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:49.320875 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:49.450475 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:49.458638 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-15281fca-678e-47fe-8259-89410a2f75d4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1728 microversion: 2.1 time: 0.152554 Oct 05 14:14:49.459528 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 240/457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:49 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:49.480849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:49.481407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:49.487668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:49.488150 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:49.488585 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:49.489309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:49.489770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:49.490971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:49.571899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-08d41085-74e6-408e-b5bb-f5939f98eb59 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094865 Oct 05 14:14:49.572501 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 218/458] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:14:49 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:49.638325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:49.640853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:49.647391 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:49.647882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:49.648327 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:49.649080 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:49.649757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:49.650407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:49.681471 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bac43ddb-2232-4e6e-8837-138c08744d3c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047043 Oct 05 14:14:49.682037 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 241/459] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 14:14:49 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:14:50.695475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:50.698488 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:50.712600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-f2a26da5-7470-4320-8912-d684356a9e4f req-eb4c2ab9-746d-4cc6-83f5-a4ce90d88c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c812772a-b68e-43af-aaa3-a872602e897a", "tag": "6c3fa8f2-59b6-418c-ad8b-641bae758166"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:50.720115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:50.721993 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:50.725327 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:50.726885 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:50.729207 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:50.731240 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:50.734154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-f2a26da5-7470-4320-8912-d684356a9e4f req-eb4c2ab9-746d-4cc6-83f5-a4ce90d88c43 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:50.737094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-f2a26da5-7470-4320-8912-d684356a9e4f req-eb4c2ab9-746d-4cc6-83f5-a4ce90d88c43 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:50.738003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-f2a26da5-7470-4320-8912-d684356a9e4f req-eb4c2ab9-746d-4cc6-83f5-a4ce90d88c43 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:50.756672 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-f2a26da5-7470-4320-8912-d684356a9e4f req-eb4c2ab9-746d-4cc6-83f5-a4ce90d88c43 service nova] Creating event network-changed:6c3fa8f2-59b6-418c-ad8b-641bae758166 for instance c812772a-b68e-43af-aaa3-a872602e897a on hv-cinder-83587 Oct 05 14:14:50.763553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-f2a26da5-7470-4320-8912-d684356a9e4f req-eb4c2ab9-746d-4cc6-83f5-a4ce90d88c43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055419 Oct 05 14:14:50.764773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 242/460] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:14:50.784693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-fadf9b1e-bd56-4172-b1b3-f5b92c46cd57 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.094399 Oct 05 14:14:50.785603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 219/461] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 14:14:50 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:50.859682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:50.860341 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:50.869082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:50.869661 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:50.870157 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:50.870868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:50.871388 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:50.871819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:50.902960 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:14:51.004498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-915dfc44-60e9-423d-8b74-96e9459c8f79 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 204 len: 0 microversion: 2.20 time: 0.149837 Oct 05 14:14:51.006860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 243/462] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 14:14:50 2022] DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 14:14:51.017413 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:51.018548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:51.026164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:51.026920 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:51.027542 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:51.028585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:51.029365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:51.029950 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:51.064183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "514d616b-3771-43cf-8a67-f87caf04fed7", "create_info": {"type": "qcow2", "new_file": "volume-514d616b-3771-43cf-8a67-f87caf04fed7.11e012d7-ad57-4342-a954-1af3594eb9f4.vhdx", "snapshot_id": "11e012d7-ad57-4342-a954-1af3594eb9f4"}}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:51.067757 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:51.068210 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:51.068644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:51.078824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:51.079562 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:51.080153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:51.094383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-c83aebe2-ec20-46bc-a981-ab42b81e32ee req-130b81af-3f53-44f7-9266-76a193d0cc2b admin admin] 10.222.0.40 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.121550 Oct 05 14:14:51.095501 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 220/463] 10.222.0.40 () {64 vars in 1326 bytes} [Wed Oct 5 14:14:50 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 14:14:51.174065 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:51.182866 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:51.184310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:51.185489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5f577650-d0d1-4d2a-a2bd-b5d4671ef38c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.173855 Oct 05 14:14:51.186044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 244/464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:51 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:52.211960 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:52.212648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:52.218779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:52.219252 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:52.219680 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:52.220357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:52.220806 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:52.221243 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:52.353618 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:52.361648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:52.363108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:52.364264 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8ea65379-e55d-4081-b63b-ee1805492955 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.157069 Oct 05 14:14:52.365324 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 221/465] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:52 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:52.783244 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-42f67c3e-ddc4-4ad4-be16-8465cc59b1e8 req-5ed5c01d-66aa-4af6-b503-75843ed635bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c812772a-b68e-43af-aaa3-a872602e897a", "tag": "6c3fa8f2-59b6-418c-ad8b-641bae758166"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:52.789033 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:52.794741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-42f67c3e-ddc4-4ad4-be16-8465cc59b1e8 req-5ed5c01d-66aa-4af6-b503-75843ed635bc service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:52.795209 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-42f67c3e-ddc4-4ad4-be16-8465cc59b1e8 req-5ed5c01d-66aa-4af6-b503-75843ed635bc service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:52.795659 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-42f67c3e-ddc4-4ad4-be16-8465cc59b1e8 req-5ed5c01d-66aa-4af6-b503-75843ed635bc service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:52.807443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-42f67c3e-ddc4-4ad4-be16-8465cc59b1e8 req-5ed5c01d-66aa-4af6-b503-75843ed635bc service nova] Creating event network-changed:6c3fa8f2-59b6-418c-ad8b-641bae758166 for instance c812772a-b68e-43af-aaa3-a872602e897a on hv-cinder-83587 Oct 05 14:14:52.812340 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-42f67c3e-ddc4-4ad4-be16-8465cc59b1e8 req-5ed5c01d-66aa-4af6-b503-75843ed635bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032764 Oct 05 14:14:52.812902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 245/466] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:53.390186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:53.390795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:53.393157 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:53.399145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:53.399626 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:53.400061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:53.400768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:53.401205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:53.401652 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:53.572879 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:53.580892 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:53.582363 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:53.583537 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-88d91525-c361-4bb6-a863-afb043a82dbc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1721 microversion: 2.20 time: 0.197181 Oct 05 14:14:53.584087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 222/467] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:53 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:54.610431 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:54.611011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:54.619316 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:54.619828 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:54.620272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:54.620987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:54.621591 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:54.622261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:54.710096 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:54.719114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:54.720583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:54.721779 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c29ed18c-6e06-4bb0-90bb-1a72feef2d02 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1654 microversion: 2.20 time: 0.116072 Oct 05 14:14:54.739645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 246/468] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:54 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1654 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:54.931059 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-2539e25d-05d7-48ea-96e1-fddafda5db26 req-b5b628b3-a52e-43a7-ba1e-5ce360665d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a20e784-a0e0-498b-b35e-698c29824ce3", "name": "network-vif-deleted", "tag": "8f163eaf-debc-4e78-b7b6-7799a1c43a57"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:54.942057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-2539e25d-05d7-48ea-96e1-fddafda5db26 req-b5b628b3-a52e-43a7-ba1e-5ce360665d86 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:54.942860 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-2539e25d-05d7-48ea-96e1-fddafda5db26 req-b5b628b3-a52e-43a7-ba1e-5ce360665d86 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:54.943468 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-2539e25d-05d7-48ea-96e1-fddafda5db26 req-b5b628b3-a52e-43a7-ba1e-5ce360665d86 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:54.957540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-2539e25d-05d7-48ea-96e1-fddafda5db26 req-b5b628b3-a52e-43a7-ba1e-5ce360665d86 service nova] Creating event network-vif-deleted:8f163eaf-debc-4e78-b7b6-7799a1c43a57 for instance 8a20e784-a0e0-498b-b35e-698c29824ce3 on hv-cinder-83587 Oct 05 14:14:54.963214 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-2539e25d-05d7-48ea-96e1-fddafda5db26 req-b5b628b3-a52e-43a7-ba1e-5ce360665d86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036835 Oct 05 14:14:54.964445 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 223/469] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:55.342511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "514d616b-3771-43cf-8a67-f87caf04fed7", "create_info": {"type": "qcow2", "new_file": "volume-514d616b-3771-43cf-8a67-f87caf04fed7.8a18a8b4-0a9e-4f67-9f3d-f5ac4a2b89c5.vhdx", "snapshot_id": "8a18a8b4-0a9e-4f67-9f3d-f5ac4a2b89c5"}}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:55.346306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.347028 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.347681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.359510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.360266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.361029 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.375175 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-ed084de2-fc22-4290-a3a0-637352d3cd70 req-5d912736-b7b4-4cf2-91bc-8059c030b6c8 admin admin] 10.222.0.40 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.089678 Oct 05 14:14:55.375827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 247/470] 10.222.0.40 () {64 vars in 1326 bytes} [Wed Oct 5 14:14:55 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:14:55.747837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:55.748537 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:55.751570 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:55.752230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:55.756254 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.756748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.757209 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.758420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.758886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.759173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.759301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.759654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.760088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.760813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.761359 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.761792 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.790546 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2515a357-b93a-4fc0-b4db-64dca6b4e6a8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/ips" status: 200 len: 150 microversion: 2.1 time: 0.053466 Oct 05 14:14:55.791091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 224/471] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:14:55 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:55.803073 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c92304b-820b-4985-8dda-e438276f85b0"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:55.804064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.804566 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.805011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.805494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lazy-loading 'fault' on Instance uuid 8a20e784-a0e0-498b-b35e-698c29824ce3 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:55.806726 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:55.812678 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.813458 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.813892 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.814608 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.815058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.815477 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.858405 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:55.867424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:55.868873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:55.872246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a4c30d86-5a16-4f7b-bf74-d3c7a07d55e2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1371 microversion: 2.20 time: 0.128922 Oct 05 14:14:55.885249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 248/472] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:55 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:55.908863 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Invalid volume: volume 3c92304b-820b-4985-8dda-e438276f85b0 is already attached to instances: 6a118798-a10a-4c6e-a661-74572c33dc01 Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: POST /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/os-volume_attachments HTTP/1.1 Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 74 Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:14:55.910138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {"volumeAttachment": {"volumeId": "3c92304b-820b-4985-8dda-e438276f85b0"}} Oct 05 14:14:55.911830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Invalid volume: volume 3c92304b-820b-4985-8dda-e438276f85b0 is already attached to instances: 6a118798-a10a-4c6e-a661-74572c33dc01 Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'server_id': '245338e3-b9ea-4ad8-909a-79f8f3e917c0', 'body': {'volumeAttachment': {'volumeId': '3c92304b-820b-4985-8dda-e438276f85b0'}}} Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3c92304b-820b-4985-8dda-e438276f85b0 is already attached to instances: 6a118798-a10a-4c6e-a661-74572c33dc01 Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:55.912774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3c92304b-820b-4985-8dda-e438276f85b0 is already attached to instances: 6a118798-a10a-4c6e-a661-74572c33dc01 Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:55.914263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3c92304b-820b-4985-8dda-e438276f85b0 is already attached to instances: 6a118798-a10a-4c6e-a661-74572c33dc01 Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 400 to user: Invalid volume: volume 3c92304b-820b-4985-8dda-e438276f85b0 is already attached to instances: 6a118798-a10a-4c6e-a661-74572c33dc01 {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-205fb726-949d-4b85-8456-e1b976441e7c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112730 Oct 05 14:14:55.916024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 225/473] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:14:55 2022] POST /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 14:14:55.920256 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:55.920752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:55.926875 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.927906 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.928335 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.929024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:55.929507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:55.929926 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:55.958400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:14:56.049278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f62e3624-544c-446f-97cc-4ac7f41c00d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 204 len: 0 microversion: 2.1 time: 0.132013 Oct 05 14:14:56.050351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 249/474] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:14:55 2022] DELETE /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:14:56.059097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:56.061510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:56.072156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:56.072767 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:56.073302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:56.074214 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:56.074808 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:56.075444 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:56.091750 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:56.229871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:56.237768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-944c3adb-642a-439c-befa-f40e4a180d89 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1681 microversion: 2.1 time: 0.182710 Oct 05 14:14:56.238330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 226/475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:56 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:14:56.900116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:56.900831 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:56.907139 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:56.907617 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:56.908046 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:56.908724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:56.909170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:56.909615 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:56.941762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:56.942231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:56.942658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:56.943090 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lazy-loading 'fault' on Instance uuid 8a20e784-a0e0-498b-b35e-698c29824ce3 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:56.984218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:56.992423 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:56.993882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:56.995019 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-55a9e77b-b69d-4c66-8832-9c8820e2cbf8 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 200 len: 1371 microversion: 2.20 time: 0.099669 Oct 05 14:14:56.995567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 250/476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:56 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:14:57.262333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:57.263067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:57.269515 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:57.270017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:57.270510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:57.271781 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:57.272229 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:57.272650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:57.403566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:57.411447 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8e05c0ca-31eb-4a7a-ba87-79bb136e6905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1681 microversion: 2.1 time: 0.152876 Oct 05 14:14:57.412017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 227/477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:57 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:58.020016 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:58.020629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:58.027671 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:58.028155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:58.028597 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:58.029319 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:58.029778 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:58.030205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:58.043082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] HTTP exception thrown: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Request method failure captured: Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 HTTP/1.1 Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCM9vppXECOf60GL0HPRRcyYip9ruuJOE5DNkdnWvptw4BfWz2Z5CppFBXHRBeqkTy1kFt9Zr-5oeaXfHEYlwExwASFP0-aNOyGC9-Wwbewn5Y8kabu5NaNfEZSWW_Ct3mSUozvet1x8LLQy3FRSbadkJ9Xt2KCGus6d_xLqxNyFuY Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:14:58.044713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791692a741cd49af91cce92a0672b57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791692a741cd49af91cce92a0672b57a"}]}] Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: e805d10dcc2e4dc7baf6792c7ca53510 Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:14:58.046363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '8a20e784-a0e0-498b-b35e-698c29824ce3'} Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:14:58.047170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:14:58.048501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:14:58.049823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Returning 404 to user: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:14:58.049823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a56ecbb2-157f-44a6-849d-441fcdfac92b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 404 len: 111 microversion: 2.20 time: 0.030033 Oct 05 14:14:58.049823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 251/478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:14:58 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:14:58.055144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6adff49b-d58f-4c3e-83eb-7ce48a45b0bb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '.version_select at 0x7f218d2f6940>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:58.075108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6adff49b-d58f-4c3e-83eb-7ce48a45b0bb tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-773430973" status: 204 len: 0 microversion: 2.20 time: 0.023791 Oct 05 14:14:58.075747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 228/479] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 5 14:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-773430973 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 14:14:58.434871 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:58.435894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:58.444781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:58.445542 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:58.446106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:58.447018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:58.448304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:58.449073 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:58.686955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:58.695043 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3c4f6a66-c487-42d2-abd4-61d7730b3c15 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1681 microversion: 2.1 time: 0.264126 Oct 05 14:14:58.696010 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 252/480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:58 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:14:58.749917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0c539195-5cc5-4341-89bb-72ebb11228c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'create', calling method: .version_select at 0x7f218d199940>, body: {"keypair": {"name": "tempest-keypair-205916231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZYPRsE75DCWq25x+avyfztd0RZA3flln+l+XbbGz51SsOitJobknDjpo9ir0gnmsFKJcwAK/vcQnr+aakkqQ675HCe0cnLwl9ObtxsLdGlt4LrXFeAUV8cEqxlr3FuQQ=="}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:58.767788 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-0c539195-5cc5-4341-89bb-72ebb11228c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for project 791692a741cd49af91cce92a0672b57a. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:14:58.772551 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-0c539195-5cc5-4341-89bb-72ebb11228c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for user e805d10dcc2e4dc7baf6792c7ca53510 and project 791692a741cd49af91cce92a0672b57a. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:14:58.796731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0c539195-5cc5-4341-89bb-72ebb11228c9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051270 Oct 05 14:14:58.797356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 229/481] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 14:14:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 14:14:59.245639 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-8dc674e2-97e7-4329-9e26-4ef0f557796a req-90cabbd6-266b-4573-bbae-4fb26873dbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245338e3-b9ea-4ad8-909a-79f8f3e917c0", "name": "network-vif-deleted", "tag": "ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:14:59.263420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-8dc674e2-97e7-4329-9e26-4ef0f557796a req-90cabbd6-266b-4573-bbae-4fb26873dbaf service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:59.264254 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-8dc674e2-97e7-4329-9e26-4ef0f557796a req-90cabbd6-266b-4573-bbae-4fb26873dbaf service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:59.264903 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-8dc674e2-97e7-4329-9e26-4ef0f557796a req-90cabbd6-266b-4573-bbae-4fb26873dbaf service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:59.312136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-8dc674e2-97e7-4329-9e26-4ef0f557796a req-90cabbd6-266b-4573-bbae-4fb26873dbaf service nova] Creating event network-vif-deleted:ba4ffca8-c3fa-4493-a82f-72fdae2d6c2d for instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 on hv-cinder-83587 Oct 05 14:14:59.326687 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-8dc674e2-97e7-4329-9e26-4ef0f557796a req-90cabbd6-266b-4573-bbae-4fb26873dbaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084572 Oct 05 14:14:59.328122 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 253/482] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:14:59.583896 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:59.587656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:59.588339 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:59.588937 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:59.598623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:59.599880 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:59.600472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:59.616496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-1d8eafec-d73b-4263-a411-9e9134fc9aec req-30ab2933-2a27-4fb8-8f3b-fa7c77484d5a admin admin] 10.222.0.40 "DELETE /compute/v2.1/os-assisted-volume-snapshots/8a18a8b4-0a9e-4f67-9f3d-f5ac4a2b89c5?delete_info=%7B%22file_to_merge%22:%20%22volume-514d616b-3771-43cf-8a67-f87caf04fed7.8a18a8b4-0a9e-4f67-9f3d-f5ac4a2b89c5.vhdx%22,%20%22volume_id%22:%20%22514d616b-3771-43cf-8a67-f87caf04fed7%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.102762 Oct 05 14:14:59.617167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 230/483] 10.222.0.40 () {62 vars in 1800 bytes} [Wed Oct 5 14:14:59 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/8a18a8b4-0a9e-4f67-9f3d-f5ac4a2b89c5?delete_info=%7B%22file_to_merge%22:%20%22volume-514d616b-3771-43cf-8a67-f87caf04fed7.8a18a8b4-0a9e-4f67-9f3d-f5ac4a2b89c5.vhdx%22,%20%22volume_id%22:%20%22514d616b-3771-43cf-8a67-f87caf04fed7%22%7D => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:14:59.718803 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:14:59.719503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:14:59.726061 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:59.726549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:59.726982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:59.727676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:59.728128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:59.728548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:59.733025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:59.764086 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:14:59.764742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:14:59.765179 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:14:59.765657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'fault' on Instance uuid 245338e3-b9ea-4ad8-909a-79f8f3e917c0 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:14:59.813317 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:14:59.821621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-65226125-8388-4939-8ad5-a5277a4eb90b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1331 microversion: 2.1 time: 0.106907 Oct 05 14:14:59.822196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 254/484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:14:59 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:00.395280 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-526431640", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8571f355-3b3e-4a98-979c-c47692c104dd"}], "security_groups": [{"name": "tempest-securitygroup--313588539"}], "key_name": "tempest-keypair-205916231", "user_data": "}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:00.502572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] validate_networks() for [('8571f355-3b3e-4a98-979c-c47692c104dd', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:15:00.845649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:00.846292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:00.853198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:00.853714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:00.854148 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:00.854845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:00.855487 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:00.855915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:00.881594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:15:00.882440 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:15:00.882919 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:15:00.883332 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:15:00.883753 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:15:00.891739 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:00.892226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:00.892661 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:00.893109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'fault' on Instance uuid 245338e3-b9ea-4ad8-909a-79f8f3e917c0 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:00.898294 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:00.899137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:00.899781 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:00.900563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:00.901026 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:00.901479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:00.922067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for project 791692a741cd49af91cce92a0672b57a. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:15:00.926034 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Getting quotas for user e805d10dcc2e4dc7baf6792c7ca53510 and project 791692a741cd49af91cce92a0672b57a. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:15:00.934960 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:00.937620 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:15:00.940013 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:15:00.942734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2596c51d-1ea1-41db-8002-9ea83466ef86 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 200 len: 1331 microversion: 2.1 time: 0.101036 Oct 05 14:15:00.943300 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 255/485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:00 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:15:00.987831 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-db067d7b-60b3-4371-b6e8-65c3c9cf2ba9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.596526 Oct 05 14:15:00.995601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 231/486] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 14:15:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 14:15:01.000419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-be08ec8e-267b-44c3-9fa4-5f75d052baff tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:01.001031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-be08ec8e-267b-44c3-9fa4-5f75d052baff tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:01.056734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-be08ec8e-267b-44c3-9fa4-5f75d052baff tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:01.064615 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-be08ec8e-267b-44c3-9fa4-5f75d052baff tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:01.066100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-be08ec8e-267b-44c3-9fa4-5f75d052baff tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:01.067201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-be08ec8e-267b-44c3-9fa4-5f75d052baff tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1280 microversion: 2.20 time: 0.070625 Oct 05 14:15:01.067756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 256/487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:00 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:15:01.965130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:01.965796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:01.972490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:01.972973 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:01.973446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:01.974137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:01.974593 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:01.975020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:01.987947 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 HTTP/1.1 Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:15:01.990051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:15:01.991534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '245338e3-b9ea-4ad8-909a-79f8f3e917c0'} Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:15:01.992231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:15:01.993559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:01.994771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:15:01.994771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bde11e33-df42-456c-acbd-9230f658c43d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 404 len: 111 microversion: 2.1 time: 0.030374 Oct 05 14:15:01.994771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 232/488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:01 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:15:02.000167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-399a2858-2dfd-413e-9f2a-9309181f0551 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '.version_select at 0x7f218d0ed430>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:02.020738 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-399a2858-2dfd-413e-9f2a-9309181f0551 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678816844" status: 202 len: 0 microversion: 2.1 time: 0.024168 Oct 05 14:15:02.021212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 257/489] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 14:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678816844 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:15:02.091402 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:02.092020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:02.098026 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:02.098745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:02.099368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:02.100074 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:02.100536 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:02.100967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:02.175007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:02.185009 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:02.186883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:02.190400 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3f7c72a9-c690-4c90-8f28-464a069b27dc tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1332 microversion: 2.20 time: 0.102949 Oct 05 14:15:02.191167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 233/490] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:02 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:02.736765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:02.740943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:02.741665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:02.742293 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:02.750524 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:02.750997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:02.751430 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:02.765834 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-be9a0513-0c43-4754-b435-9e99d455444d req-e703fbb4-e6dd-41f0-a2d6-93d937116d84 admin admin] 10.222.0.40 "DELETE /compute/v2.1/os-assisted-volume-snapshots/9afb8145-461d-4a37-b567-bd07e0d6f107?delete_info=%7B%22file_to_merge%22:%20%22volume-514d616b-3771-43cf-8a67-f87caf04fed7.9afb8145-461d-4a37-b567-bd07e0d6f107.vhdx%22,%20%22volume_id%22:%20%22514d616b-3771-43cf-8a67-f87caf04fed7%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078520 Oct 05 14:15:02.766755 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 258/491] 10.222.0.40 () {62 vars in 1800 bytes} [Wed Oct 5 14:15:02 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/9afb8145-461d-4a37-b567-bd07e0d6f107?delete_info=%7B%22file_to_merge%22:%20%22volume-514d616b-3771-43cf-8a67-f87caf04fed7.9afb8145-461d-4a37-b567-bd07e0d6f107.vhdx%22,%20%22volume_id%22:%20%22514d616b-3771-43cf-8a67-f87caf04fed7%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:15:03.218195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:03.219417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:03.232548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:03.233169 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:03.233729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:03.234537 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:03.235094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:03.235640 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:03.243311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:03.244447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:03.250865 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:03.251421 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:03.252057 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:03.252760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:03.253374 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:03.253810 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:03.314021 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:03.325111 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:03.326663 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:03.327994 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-06993521-dfff-45d4-8112-de2756fe325a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1338 microversion: 2.20 time: 0.114199 Oct 05 14:15:03.337124 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 234/492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:03 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1338 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:03.348064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'services' on Instance uuid 6a118798-a10a-4c6e-a661-74572c33dc01 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:03.423355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0c4f62c5-6c83-4b77-9fba-d4f0ec26c319 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments/3c92304b-820b-4985-8dda-e438276f85b0" status: 202 len: 0 microversion: 2.1 time: 0.184881 Oct 05 14:15:03.423956 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 259/493] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:15:03 2022] DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments/3c92304b-820b-4985-8dda-e438276f85b0 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:15:03.432732 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:03.435048 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:03.440972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:03.441849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:03.442420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:03.443728 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:03.444250 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:03.444685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:03.488648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b3eef433-8a13-43d4-aabe-9602144a4107 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054563 Oct 05 14:15:03.496114 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 235/494] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:15:03 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:04.356915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:04.357652 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:04.363916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:04.364396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:04.364837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:04.365836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:04.366287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:04.366715 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:04.503908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:04.506100 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:04.517524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:04.518013 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:04.518464 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:04.519166 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:04.519626 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:04.520063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:04.553567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4605a9cf-729e-4ce6-91e5-182d05516adb tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053395 Oct 05 14:15:04.554398 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 236/495] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:15:04 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:04.573338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:04.586435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:04.587905 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:04.589114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f97670aa-ce3c-49b1-aae7-ac34919029c5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1405 microversion: 2.20 time: 0.238465 Oct 05 14:15:04.589782 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 260/496] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:04 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:04.733515 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-a825a204-f7cd-4ddf-bc16-a87a027f6563 req-2f1868ec-1a74-4a6a-8439-aeb480fa5a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:04.745514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-a825a204-f7cd-4ddf-bc16-a87a027f6563 req-2f1868ec-1a74-4a6a-8439-aeb480fa5a5b service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:04.746124 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-a825a204-f7cd-4ddf-bc16-a87a027f6563 req-2f1868ec-1a74-4a6a-8439-aeb480fa5a5b service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:04.746552 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-a825a204-f7cd-4ddf-bc16-a87a027f6563 req-2f1868ec-1a74-4a6a-8439-aeb480fa5a5b service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:04.759108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-a825a204-f7cd-4ddf-bc16-a87a027f6563 req-2f1868ec-1a74-4a6a-8439-aeb480fa5a5b service nova] Creating event network-changed:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:15:04.766022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-a825a204-f7cd-4ddf-bc16-a87a027f6563 req-2f1868ec-1a74-4a6a-8439-aeb480fa5a5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 Oct 05 14:15:04.766549 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 237/497] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:15:05.565923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:05.568168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:05.574583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.575063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.575494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.576211 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.576660 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.577085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.605303 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c6ee4f10-63bc-4770-a007-f85ce933c876 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043284 Oct 05 14:15:05.605844 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 261/498] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:15:05 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:15:05.615868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:05.616569 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:05.622707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.623193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.623684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.624569 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.625029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.625488 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.669054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:05.669584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:05.675727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.676485 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.676818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.678605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.679252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.679868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.706300 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:15:05.765592 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:05.776057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:05.778305 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:05.782205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5172660f-0200-466a-bd16-400b45cbf2f9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1405 microversion: 2.20 time: 0.171423 Oct 05 14:15:05.784364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 238/499] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:05 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:05.791583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-70865acd-eb21-44d9-a102-7be62d300f81 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 204 len: 0 microversion: 2.1 time: 0.126057 Oct 05 14:15:05.792198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 262/500] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:15:05 2022] DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:15:05.800302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:05.800886 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:05.807399 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.807890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.808369 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.809014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.809503 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.809924 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.941613 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:05.949383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-90136386-3eb3-443b-8779-e99574122ab3 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1681 microversion: 2.1 time: 0.152969 Oct 05 14:15:05.950084 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 239/501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:05 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:05.963205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:05.966457 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.966936 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.967365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.976156 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:05.976618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:05.977046 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:05.992369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-bbcc8e00-6732-41c6-ac85-26343fefdab0 req-1ed27ad0-f485-444a-8d64-6ba147bf1eb9 admin admin] 10.222.0.40 "DELETE /compute/v2.1/os-assisted-volume-snapshots/11e012d7-ad57-4342-a954-1af3594eb9f4?delete_info=%7B%22file_to_merge%22:%20%22volume-514d616b-3771-43cf-8a67-f87caf04fed7.11e012d7-ad57-4342-a954-1af3594eb9f4.vhdx%22,%20%22volume_id%22:%20%22514d616b-3771-43cf-8a67-f87caf04fed7%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078607 Oct 05 14:15:05.993521 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 263/502] 10.222.0.40 () {62 vars in 1800 bytes} [Wed Oct 5 14:15:05 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/11e012d7-ad57-4342-a954-1af3594eb9f4?delete_info=%7B%22file_to_merge%22:%20%22volume-514d616b-3771-43cf-8a67-f87caf04fed7.11e012d7-ad57-4342-a954-1af3594eb9f4.vhdx%22,%20%22volume_id%22:%20%22514d616b-3771-43cf-8a67-f87caf04fed7%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:15:06.808575 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:06.809185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:06.815635 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:06.816122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:06.816566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:06.817275 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:06.817739 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:06.818162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:06.947733 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:06.955606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:06.957039 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:06.958162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d1bba935-26c7-4ecd-8072-37b252e066fa tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1405 microversion: 2.20 time: 0.153527 Oct 05 14:15:06.958709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 240/503] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:06 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:06.975347 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:06.976076 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:06.982387 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:06.982866 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:06.983305 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:06.983995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:06.984453 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:06.984881 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:07.109306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:07.118040 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-df8aa405-8443-4934-90e4-1e01a7660420 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1681 microversion: 2.1 time: 0.148466 Oct 05 14:15:07.118599 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 264/504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:06 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:07.982164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:07.982785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:07.989077 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:07.990121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:07.990796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:07.991482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:07.991936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:07.992359 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:08.119509 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:08.127479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:08.128930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:08.130670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e257eddd-51f3-46b3-b58a-0ada6228556b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1405 microversion: 2.20 time: 0.152007 Oct 05 14:15:08.131225 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 241/505] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:07 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:08.142952 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:08.143892 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:08.154325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:08.155137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:08.155907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:08.156763 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:08.157245 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:08.157676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:08.284540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:08.292972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e745d619-1f3e-4841-a2b1-3cd028fe796d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1681 microversion: 2.1 time: 0.154058 Oct 05 14:15:08.293901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 265/506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:08 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:09.155341 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:09.155948 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:09.162765 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:09.163245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:09.163676 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:09.164362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:09.164811 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:09.165257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:09.315819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:09.316693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:09.323216 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:09.323818 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:09.324486 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:09.325483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:09.326150 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:09.326938 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:09.419211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:09.431650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:09.433306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:09.434547 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f1515d6f-1677-4054-9ee4-54867ac2ca72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1405 microversion: 2.20 time: 0.283129 Oct 05 14:15:09.435177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 242/507] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:09 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:09.480772 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:09.488455 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-988eb52c-1123-425a-a205-0d58add64707 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1681 microversion: 2.1 time: 0.176483 Oct 05 14:15:09.489113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 266/508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:09 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:09.943952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-46a29a7f-4519-4392-b7a3-f1432fa636c3 req-c13089a6-5932-4457-8f07-3745144bf436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "name": "network-vif-plugged", "status": "completed", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:09.953355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-46a29a7f-4519-4392-b7a3-f1432fa636c3 req-c13089a6-5932-4457-8f07-3745144bf436 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:09.954198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-46a29a7f-4519-4392-b7a3-f1432fa636c3 req-c13089a6-5932-4457-8f07-3745144bf436 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:09.954771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-46a29a7f-4519-4392-b7a3-f1432fa636c3 req-c13089a6-5932-4457-8f07-3745144bf436 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:09.967809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-46a29a7f-4519-4392-b7a3-f1432fa636c3 req-c13089a6-5932-4457-8f07-3745144bf436 service nova] Creating event network-vif-plugged:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:15:09.972532 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-46a29a7f-4519-4392-b7a3-f1432fa636c3 req-c13089a6-5932-4457-8f07-3745144bf436 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Oct 05 14:15:09.973383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 243/509] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:10.362510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-d155ab9c-f574-4f08-9146-20710597e61d req-bd5bb89c-6e24-427a-a04d-38ea6d7a4bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a118798-a10a-4c6e-a661-74572c33dc01", "name": "network-vif-deleted", "tag": "e2788610-56cd-4f83-8e15-a312fbac3726"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:10.372375 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d155ab9c-f574-4f08-9146-20710597e61d req-bd5bb89c-6e24-427a-a04d-38ea6d7a4bd1 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:10.372844 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d155ab9c-f574-4f08-9146-20710597e61d req-bd5bb89c-6e24-427a-a04d-38ea6d7a4bd1 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:10.373290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d155ab9c-f574-4f08-9146-20710597e61d req-bd5bb89c-6e24-427a-a04d-38ea6d7a4bd1 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:10.383981 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-d155ab9c-f574-4f08-9146-20710597e61d req-bd5bb89c-6e24-427a-a04d-38ea6d7a4bd1 service nova] Creating event network-vif-deleted:e2788610-56cd-4f83-8e15-a312fbac3726 for instance 6a118798-a10a-4c6e-a661-74572c33dc01 on hv-cinder-83587 Oct 05 14:15:10.388723 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-d155ab9c-f574-4f08-9146-20710597e61d req-bd5bb89c-6e24-427a-a04d-38ea6d7a4bd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029944 Oct 05 14:15:10.389324 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 267/510] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:10.461267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:10.462598 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:10.476714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:10.477479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:10.478094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:10.478944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:10.479551 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:10.480137 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:10.512106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:10.512808 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:10.522976 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:10.523464 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:10.523894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:10.524596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:10.525045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:10.525494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:10.608133 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:10.617005 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5b00e899-0ac5-46f1-b3f1-24bed24035b0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1325 microversion: 2.1 time: 0.109112 Oct 05 14:15:10.617670 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 268/511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:10 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1325 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:15:10.664789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:10.673189 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:10.674706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:10.675814 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2ef48f7b-d32d-47ae-953c-ce6089c9edce tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1405 microversion: 2.20 time: 0.220339 Oct 05 14:15:10.676375 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 244/512] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:10 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:15:10.989726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:10.991137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:11.006463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.006813 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.007481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.008193 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.008748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.009174 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.061809 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:11.097762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lazy-loading 'services' on Instance uuid 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:11.177011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-aabc9208-cd87-40d7-b1f6-2495205496b2 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749/os-volume_attachments/514d616b-3771-43cf-8a67-f87caf04fed7" status: 202 len: 0 microversion: 2.1 time: 0.190958 Oct 05 14:15:11.178511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 269/513] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:15:10 2022] DELETE /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749/os-volume_attachments/514d616b-3771-43cf-8a67-f87caf04fed7 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:15:11.639810 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:11.640429 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:11.642385 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:11.643076 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=10 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:11.649705 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.650188 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.650624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.651308 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.651767 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.652193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.686446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.686925 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.687360 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.687803 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'fault' on Instance uuid 6a118798-a10a-4c6e-a661-74572c33dc01 {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:11.700483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:11.701175 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:11.708170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.708667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.709694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.710390 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.710838 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.711260 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.728014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:11.735583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6cc55380-764a-4fde-890e-b61b5c9d876b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 200 len: 1330 microversion: 2.1 time: 0.099589 Oct 05 14:15:11.736147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 245/514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:11 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:11.843089 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:11.851670 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:11.853106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:11.854269 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4d4d377e-dbeb-4354-9791-d3de39574fca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1595 microversion: 2.20 time: 0.158014 Oct 05 14:15:11.854817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 270/515] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:11 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:15:11.878379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:11.878878 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:11.884704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.885187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.885678 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.886349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:11.886806 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:11.887235 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:11.965929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ef8a7736-3856-4d81-9be6-748966e9fea0 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091309 Oct 05 14:15:11.966574 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 246/516] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 14:15:11 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 14:15:12.759561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:12.760183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:12.766329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:12.766825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:12.767263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:12.767967 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:12.768427 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:12.768880 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:12.773199 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:12.783863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 HTTP/1.1 Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:15:12.785674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:15:12.787489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '6a118798-a10a-4c6e-a661-74572c33dc01'} Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:15:12.788234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:15:12.789491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:12.791079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:15:12.791079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-82bdf15a-96fd-469d-82ef-e7292271f695 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 404 len: 111 microversion: 2.1 time: 0.031900 Oct 05 14:15:12.791079 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 271/517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:12 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:15:12.800301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e0088378-76ee-4f5e-bc25-16b68276304f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '.version_select at 0x7f218d19b280>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:12.819134 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e0088378-76ee-4f5e-bc25-16b68276304f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249934817" status: 202 len: 0 microversion: 2.1 time: 0.023122 Oct 05 14:15:12.819755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 247/518] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 14:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249934817 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:15:12.913182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-e4698dbf-5130-4043-b2b2-77f67bdcca18 req-03bcf3d0-303c-4833-8b47-4a06bd19f15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:12.923750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e4698dbf-5130-4043-b2b2-77f67bdcca18 req-03bcf3d0-303c-4833-8b47-4a06bd19f15d service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:12.924478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e4698dbf-5130-4043-b2b2-77f67bdcca18 req-03bcf3d0-303c-4833-8b47-4a06bd19f15d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:12.924909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e4698dbf-5130-4043-b2b2-77f67bdcca18 req-03bcf3d0-303c-4833-8b47-4a06bd19f15d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:12.939997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-e4698dbf-5130-4043-b2b2-77f67bdcca18 req-03bcf3d0-303c-4833-8b47-4a06bd19f15d service nova] Creating event network-changed:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:15:12.945811 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-e4698dbf-5130-4043-b2b2-77f67bdcca18 req-03bcf3d0-303c-4833-8b47-4a06bd19f15d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 Oct 05 14:15:12.946890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 272/519] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:13.368971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:13.369498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:13.375525 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:13.376023 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:13.376461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:13.377158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:13.377640 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:13.378262 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:13.405064 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:15:13.429557 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=100 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:13.488383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e965cb75-6a71-481f-ba78-c5d8ddc63d59 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 204 len: 0 microversion: 2.1 time: 0.122991 Oct 05 14:15:13.489887 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 248/520] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:15:13 2022] DELETE /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:15:13.499303 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:13.500223 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:13.507342 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:13.508012 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:13.508597 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:13.509658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:13.510265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:13.510863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:13.665554 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:13.674765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6246389f-81d0-4117-900f-64505c2e783d tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1513 microversion: 2.1 time: 0.179962 Oct 05 14:15:13.675704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 273/521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:13 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:13.733101 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-fa8d56f5-1e59-497c-872e-b58d92ff2e20 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: .version_select at 0x7f218d19bc10>, body: {"keypair": {"name": "tempest-keypair-926446023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqGcbzwpckACg3rotqJt2x9ek61Ggx2CeEdGtOS+Uxa0aA1ZL0Yvm2GhiegPd5TbTlKR2dDXXA+7rXWhqGgltnUl1JovfXN++tN4MK1wEnXNi6hfONvhHoCy9ZoxLC8jg=="}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:13.750047 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-fa8d56f5-1e59-497c-872e-b58d92ff2e20 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:15:13.753918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-fa8d56f5-1e59-497c-872e-b58d92ff2e20 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:15:13.769068 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:13.778937 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-fa8d56f5-1e59-497c-872e-b58d92ff2e20 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050505 Oct 05 14:15:13.779531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 249/522] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:15:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:14.698295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:14.699649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:14.706054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:14.706533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:14.706962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:14.707673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:14.708121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:14.708538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:14.843431 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:14.851886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8639f7ba-8b05-4882-b28a-2cc56627d2d4 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1513 microversion: 2.1 time: 0.157608 Oct 05 14:15:14.852459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 274/523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:14 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:15.027749 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-481752337", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acdcb2d2-e854-4a1a-88ab-e50e826e09dc"}], "security_groups": [{"name": "tempest-securitygroup--306676673"}], "key_name": "tempest-keypair-926446023", "user_data": "}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:15.131523 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] validate_networks() for [('acdcb2d2-e854-4a1a-88ab-e50e826e09dc', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:15:15.488950 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:15:15.489425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:15:15.490653 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:15:15.491062 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:15:15.491473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:15:15.500113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:15.500588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:15.501021 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:15.501781 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:15.502240 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:15.502660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:15.519748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:15:15.523659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:15:15.534317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:15:15.536644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:15:15.584022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9de7ea4b-5791-46c5-bf90-10ad4dbee866 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560985 Oct 05 14:15:15.584663 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 250/524] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:15:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:15:15.595942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d193f703-cac2-4900-a5bc-3816e3c853d4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:15.596565 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d193f703-cac2-4900-a5bc-3816e3c853d4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:15.649972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d193f703-cac2-4900-a5bc-3816e3c853d4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:15.656761 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d193f703-cac2-4900-a5bc-3816e3c853d4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1240 microversion: 2.1 time: 0.064874 Oct 05 14:15:15.657380 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 275/525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:15 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:15.874950 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:15.875567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:15.881808 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:15.882305 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:15.882744 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:15.883435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:15.883893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:15.884325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:16.017556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:16.025324 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c1d9fffa-a058-47fa-bceb-d407bbff06da tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1513 microversion: 2.1 time: 0.154253 Oct 05 14:15:16.025883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 251/526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:15 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:15:16.679580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:16.680193 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:16.682619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=6 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:16.687863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:16.688343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:16.688781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:16.689493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:16.689951 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:16.690375 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:16.750109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:16.758179 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-057b8f8f-667d-40b9-b3d9-1daa5cabe8ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1244 microversion: 2.1 time: 0.082424 Oct 05 14:15:16.758745 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 276/527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:16 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:17.047742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:17.048358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:17.055231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:17.055713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:17.056148 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:17.056841 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:17.057321 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:17.057746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:17.181971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:17.189791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-eee78727-2d07-4768-ae66-8c80d1bfeaf1 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1513 microversion: 2.1 time: 0.145913 Oct 05 14:15:17.190355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 252/528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:17 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:17.781358 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:17.781968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:17.789131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:17.789721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:17.790158 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:17.790847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:17.791304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:17.791728 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:17.851241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:17.858706 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ca6cb7b5-300f-455e-a7c1-70fe3ec8f6d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1244 microversion: 2.1 time: 0.081280 Oct 05 14:15:17.859259 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 277/529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:17 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:18.214170 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:18.215577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:18.222258 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:18.222746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:18.223185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:18.223898 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:18.224363 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:18.224795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:18.687217 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7a95f6608401ab05b1dcf8767aa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e576ffa90d4118991edb48723664dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:18.696813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-51b9e97e-19a4-438f-b913-c2c2216da2a5 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 200 len: 1513 microversion: 2.1 time: 0.487300 Oct 05 14:15:18.697420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 253/530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:18 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:18.881533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:18.882154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:18.888581 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:18.889246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:18.889693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:18.890403 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:18.892723 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:18.893771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:18.992190 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:19.000756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-52d0547e-6b14-4a03-85d6-e1de8c160291 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1310 microversion: 2.1 time: 0.123467 Oct 05 14:15:19.001366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 278/531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:18 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1310 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:19.041293 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-5ceeee90-e093-4c8c-9c93-04c62a32a37c req-5e42813f-57c7-4f53-8514-beb68eff36a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2a03a2-b8e4-40e1-be24-d9026cc4c749", "name": "network-vif-deleted", "tag": "8a2efeaf-7ff0-4faa-a18d-89836825886d"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:19.054406 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-5ceeee90-e093-4c8c-9c93-04c62a32a37c req-5e42813f-57c7-4f53-8514-beb68eff36a1 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:19.055250 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-5ceeee90-e093-4c8c-9c93-04c62a32a37c req-5e42813f-57c7-4f53-8514-beb68eff36a1 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:19.055689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-5ceeee90-e093-4c8c-9c93-04c62a32a37c req-5e42813f-57c7-4f53-8514-beb68eff36a1 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:19.073190 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-5ceeee90-e093-4c8c-9c93-04c62a32a37c req-5e42813f-57c7-4f53-8514-beb68eff36a1 service nova] Creating event network-vif-deleted:8a2efeaf-7ff0-4faa-a18d-89836825886d for instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 on hv-cinder-83587 Oct 05 14:15:19.078750 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-5ceeee90-e093-4c8c-9c93-04c62a32a37c req-5e42813f-57c7-4f53-8514-beb68eff36a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041636 Oct 05 14:15:19.079384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 254/532] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:19.721546 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:19.722416 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] [instance: 7b2a03a2-b8e4-40e1-be24-d9026cc4c749] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:19.729429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:19.730099 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:19.730835 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:19.731609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:19.732163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:19.732780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:19.747438 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] HTTP exception thrown: Instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 could not be found. Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Request method failure captured: Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 HTTP/1.1 Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDwTxZ-LCzabxsvd-Hx9ztUt4d3VPSKzosksLv11J5etpPXKp081ry8T0ghKx655kF1oXTshrPxFG-ISPJeung3gNh6K5DbzsfgLBiVOZ_8p8YRl0eT1wn__aGEHxmmcDJXBix3JlwqPWGlwM_AOxLJEeLacUJ_Ae4Odwaq-86PbVw Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: c5e576ffa90d4118991edb48723664dc Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1709654720 Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:15:19.749101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5e576ffa90d4118991edb48723664dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5e576ffa90d4118991edb48723664dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5e576ffa90d4118991edb48723664dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5e576ffa90d4118991edb48723664dc"}]}] Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-VolumesSnapshotTestJSON-1709654720 Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: c5e576ffa90d4118991edb48723664dc Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1709654720 Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-VolumesSnapshotTestJSON-1709654720-project Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5da7a95f6608401ab05b1dcf8767aa0f Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-VolumesSnapshotTestJSON-1709654720-project Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 could not be found. Oct 05 14:15:19.750531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '7b2a03a2-b8e4-40e1-be24-d9026cc4c749'} Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 could not be found. Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:15:19.751398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 could not be found. Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 could not be found. Oct 05 14:15:19.752721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:19.755017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] Returning 404 to user: Instance 7b2a03a2-b8e4-40e1-be24-d9026cc4c749 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:15:19.755017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d31d5f6f-6c1e-4fe9-9379-646108688ba7 tempest-VolumesSnapshotTestJSON-1709654720 tempest-VolumesSnapshotTestJSON-1709654720-project] 10.222.0.16 "GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749" status: 404 len: 111 microversion: 2.1 time: 0.033227 Oct 05 14:15:19.755017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 279/533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:19 2022] GET /compute/v2.1/servers/7b2a03a2-b8e4-40e1-be24-d9026cc4c749 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:15:20.024900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:20.025742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:20.035060 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:20.035717 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:20.036402 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:20.037731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:20.038439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:20.039221 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:20.207933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:20.215952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0683c40b-4d68-49ef-8eed-a5ae45703347 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.196113 Oct 05 14:15:20.216600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 255/534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:20 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:20.341992 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-bc745ef4-94ef-464d-96e6-993c46c354bd req-3ef03f2e-bfbc-45d5-a6e2-a7580298e670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a8c159-6cf1-4a0e-87cb-a0035fe3730a", "tag": "ae45347c-954e-4d4c-9e2c-21e0273aa89d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:20.353210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bc745ef4-94ef-464d-96e6-993c46c354bd req-3ef03f2e-bfbc-45d5-a6e2-a7580298e670 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:20.353773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bc745ef4-94ef-464d-96e6-993c46c354bd req-3ef03f2e-bfbc-45d5-a6e2-a7580298e670 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:20.361166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-bc745ef4-94ef-464d-96e6-993c46c354bd req-3ef03f2e-bfbc-45d5-a6e2-a7580298e670 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:20.375807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-bc745ef4-94ef-464d-96e6-993c46c354bd req-3ef03f2e-bfbc-45d5-a6e2-a7580298e670 service nova] Creating event network-changed:ae45347c-954e-4d4c-9e2c-21e0273aa89d for instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a on hv-cinder-83587 Oct 05 14:15:20.380737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-bc745ef4-94ef-464d-96e6-993c46c354bd req-3ef03f2e-bfbc-45d5-a6e2-a7580298e670 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042388 Oct 05 14:15:20.381490 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 280/535] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:21.241726 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:21.242692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:21.249913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:21.250392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:21.250822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:21.251509 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:21.251960 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:21.252377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:21.399862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:21.407418 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-98699b81-2b98-4803-a796-ba26b07743c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.171999 Oct 05 14:15:21.407975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 256/536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:21 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:22.431860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:22.432553 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:22.438457 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:22.438933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:22.439364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:22.440071 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:22.440520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:22.440939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:22.572969 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:22.581432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0ae2a27a-1d04-4599-be2f-0c0798096780 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.154111 Oct 05 14:15:22.582129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 281/537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:22 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:23.606376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:23.607020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:23.613533 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:23.614017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:23.614451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:23.616057 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:23.616514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:23.616939 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:23.745531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:23.751883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-785f009c-5991-41a5-afcb-710bd5b51582 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.149325 Oct 05 14:15:23.752509 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 257/538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:23 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:24.774755 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:24.775357 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:24.777896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:24.783537 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:24.784025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:24.784440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:24.785130 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:24.785602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:24.786025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:24.919387 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:24.927042 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-477e082e-1a08-4a58-9f23-fbab985ba04c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.156229 Oct 05 14:15:24.928159 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 282/539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:24 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:25.173520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:25.174105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:25.180496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:25.180983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:25.181458 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:25.182153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:25.182617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:25.183045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:25.263628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lazy-loading 'services' on Instance uuid c812772a-b68e-43af-aaa3-a872602e897a {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:25.375504 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-177a6c13-e567-40e3-9ce3-e97f545afbbc tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments/db01041f-b6f1-4976-83a0-c890895b06da" status: 202 len: 0 microversion: 2.1 time: 0.206418 Oct 05 14:15:25.376094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 258/540] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:15:25 2022] DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments/db01041f-b6f1-4976-83a0-c890895b06da => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:15:25.384866 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:25.387235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:25.393283 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:25.393849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:25.394251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:25.395031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:25.395757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:25.396048 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:25.427263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fae4a96f-607d-4271-ad4e-107334a3226a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Oct 05 14:15:25.427861 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 283/541] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:15:25 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:25.948287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:25.949354 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=10 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:25.954285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:25.955157 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:25.963017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:25.963561 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:25.964094 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:25.964891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:25.965469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:25.965993 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.027467 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-d3e319bc-0b60-4423-897d-fd21d1f68668 req-4fb63a68-ca75-4356-9757-f430184a1e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a8c159-6cf1-4a0e-87cb-a0035fe3730a", "name": "network-vif-plugged", "status": "completed", "tag": "ae45347c-954e-4d4c-9e2c-21e0273aa89d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:26.033171 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:26.040149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d3e319bc-0b60-4423-897d-fd21d1f68668 req-4fb63a68-ca75-4356-9757-f430184a1e1b service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.040704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d3e319bc-0b60-4423-897d-fd21d1f68668 req-4fb63a68-ca75-4356-9757-f430184a1e1b service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.041331 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d3e319bc-0b60-4423-897d-fd21d1f68668 req-4fb63a68-ca75-4356-9757-f430184a1e1b service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.053459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-d3e319bc-0b60-4423-897d-fd21d1f68668 req-4fb63a68-ca75-4356-9757-f430184a1e1b service nova] Creating event network-vif-plugged:ae45347c-954e-4d4c-9e2c-21e0273aa89d for instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a on hv-cinder-83587 Oct 05 14:15:26.058907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-d3e319bc-0b60-4423-897d-fd21d1f68668 req-4fb63a68-ca75-4356-9757-f430184a1e1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034713 Oct 05 14:15:26.059268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 284/542] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:26.111277 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:26.119455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3942b884-d11f-468f-b8db-179e3e344c2a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.172626 Oct 05 14:15:26.120021 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 259/543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:25 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:26.440994 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:26.443321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:26.449570 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.450287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.450906 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.451620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.452074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.452498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.481719 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c960b79c-88ff-4f3d-b886-083889ee3322 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045466 Oct 05 14:15:26.482270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 285/544] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:15:26 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:15:26.563926 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:26.564463 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:26.571315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.571796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.572231 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.572938 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.573420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.573846 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.598105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:15:26.670793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-27fedeec-a1fe-45f4-90d0-b2d365afa945 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 204 len: 0 microversion: 2.1 time: 0.110462 Oct 05 14:15:26.671356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 260/545] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:15:26 2022] DELETE /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:15:26.680336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:26.680945 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:26.686809 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.687278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.687766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.688576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:26.690123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:26.690577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:26.824188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:26.831862 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6cd28e49-f15c-4e8f-a096-dbc6283723c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1688 microversion: 2.1 time: 0.155326 Oct 05 14:15:26.832431 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 286/546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:26 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:27.143693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:27.144314 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:27.150229 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:27.150718 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:27.151158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:27.151849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:27.152309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:27.152736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:27.278519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:27.286131 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9d046e9d-f593-4517-baf3-039b9af89a0c tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.146723 Oct 05 14:15:27.286691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 261/547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:27 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:27.855196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:27.855837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:27.862170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:27.862660 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:27.863096 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:27.863777 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:27.864233 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:27.864656 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:27.992948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:28.000731 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-769e0007-fa24-4e90-aeb5-7e4208b07e58 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1688 microversion: 2.1 time: 0.149367 Oct 05 14:15:28.001329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 287/548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:27 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:28.309350 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:28.309962 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:28.316268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:28.316739 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:28.317168 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:28.317868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:28.318317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:28.318734 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:28.444983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:28.452439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7b0433b3-5872-4044-839f-e8f0c118988d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.146971 Oct 05 14:15:28.452987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 262/549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:28 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:29.024259 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:29.024877 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:29.030734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:29.031220 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:29.031656 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:29.032341 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:29.032840 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:29.033286 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:29.167618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:29.175343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b419b70d-9b62-4020-87e4-c8c492a3fd81 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1688 microversion: 2.1 time: 0.155474 Oct 05 14:15:29.175905 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 288/550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:29 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:29.475422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:29.475933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:29.482302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:29.482785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:29.483221 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:29.483910 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:29.484364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:29.484791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:29.610230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:29.618303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d46fc31d-be52-48a0-96b8-f44911f14905 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.147325 Oct 05 14:15:29.618864 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 263/551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:29 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:30.199325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:30.199946 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:30.206693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:30.207234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:30.207754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:30.208440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:30.209676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:30.210183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:30.342396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:30.350074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5c6133b4-0f5a-451a-a1d8-278270bb845a tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1688 microversion: 2.1 time: 0.154727 Oct 05 14:15:30.350632 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 289/552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:30 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:30.640771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:30.641331 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:30.647586 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:30.648059 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:30.648489 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:30.649162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:30.649643 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:30.650065 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:30.664495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:30.784124 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:30.792316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-56e433fc-47ef-4cb7-a958-5c96382bcb2d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1365 microversion: 2.1 time: 0.155379 Oct 05 14:15:30.792871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 264/553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:30 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:31.373250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:31.373958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:31.380588 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:31.381166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:31.381671 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:31.382378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:31.382837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:31.383363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:31.626704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:31.635025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2981c350-22ff-4671-ba49-8069adf28064 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1688 microversion: 2.1 time: 0.265609 Oct 05 14:15:31.635794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 290/554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:31 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1688 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:31.817475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:31.818704 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:31.825111 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:31.825287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:31.825683 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:31.826491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:31.826943 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:31.827360 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:31.960711 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:31.968489 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e3f6ab1a-c929-45dc-8594-9c52cdd004e9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1555 microversion: 2.1 time: 0.156221 Oct 05 14:15:31.969066 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 265/555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:31 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:31.991119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:31.991625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:31.997717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:31.998276 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:31.998714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:31.999403 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:31.999856 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:32.000276 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:32.096925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3998739b-ac5a-43b1-8305-d1aad69436e2 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110285 Oct 05 14:15:32.097559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 291/556] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:15:31 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:32.157265 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-49e5afff-8cba-4f71-80fc-5459ef898557 req-6800fe16-1a04-48fc-90f3-61559aaaca26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812772a-b68e-43af-aaa3-a872602e897a", "name": "network-vif-deleted", "tag": "6c3fa8f2-59b6-418c-ad8b-641bae758166"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:32.182401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-49e5afff-8cba-4f71-80fc-5459ef898557 req-6800fe16-1a04-48fc-90f3-61559aaaca26 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:32.183013 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-49e5afff-8cba-4f71-80fc-5459ef898557 req-6800fe16-1a04-48fc-90f3-61559aaaca26 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:32.183350 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-49e5afff-8cba-4f71-80fc-5459ef898557 req-6800fe16-1a04-48fc-90f3-61559aaaca26 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:32.228508 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-49e5afff-8cba-4f71-80fc-5459ef898557 req-6800fe16-1a04-48fc-90f3-61559aaaca26 service nova] Creating event network-vif-deleted:6c3fa8f2-59b6-418c-ad8b-641bae758166 for instance c812772a-b68e-43af-aaa3-a872602e897a on hv-cinder-83587 Oct 05 14:15:32.246233 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-49e5afff-8cba-4f71-80fc-5459ef898557 req-6800fe16-1a04-48fc-90f3-61559aaaca26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090533 Oct 05 14:15:32.247345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 266/557] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:32.658825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:32.659380 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:32.665733 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:32.666227 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:32.666884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:32.667600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:32.668064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:32.668491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:32.689520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:32.704302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:32.704794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:32.705252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:32.705714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lazy-loading 'fault' on Instance uuid c812772a-b68e-43af-aaa3-a872602e897a {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:32.758791 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:32.769345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e3636b3d-40b0-4fd1-b2e2-31269da73705 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 200 len: 1335 microversion: 2.1 time: 0.114422 Oct 05 14:15:32.771145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 292/558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:32 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:33.162099 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-0b5c481e-5b5d-4df1-b474-d164ea661bce req-1273bf5e-7316-4a19-80e8-31346bd04200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a8c159-6cf1-4a0e-87cb-a0035fe3730a", "tag": "ae45347c-954e-4d4c-9e2c-21e0273aa89d"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:33.172058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-0b5c481e-5b5d-4df1-b474-d164ea661bce req-1273bf5e-7316-4a19-80e8-31346bd04200 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:33.172796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-0b5c481e-5b5d-4df1-b474-d164ea661bce req-1273bf5e-7316-4a19-80e8-31346bd04200 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:33.173446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-0b5c481e-5b5d-4df1-b474-d164ea661bce req-1273bf5e-7316-4a19-80e8-31346bd04200 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:33.185155 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-0b5c481e-5b5d-4df1-b474-d164ea661bce req-1273bf5e-7316-4a19-80e8-31346bd04200 service nova] Creating event network-changed:ae45347c-954e-4d4c-9e2c-21e0273aa89d for instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a on hv-cinder-83587 Oct 05 14:15:33.190365 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-0b5c481e-5b5d-4df1-b474-d164ea661bce req-1273bf5e-7316-4a19-80e8-31346bd04200 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032765 Oct 05 14:15:33.191269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 267/559] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:33.793320 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:33.793919 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c812772a-b68e-43af-aaa3-a872602e897a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:33.800180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:33.800695 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:33.801124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:33.801836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:33.802532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:33.802951 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:33.816813 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] HTTP exception thrown: Instance c812772a-b68e-43af-aaa3-a872602e897a could not be found. Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Request method failure captured: Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a HTTP/1.1 Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCRux-cKlIsxHKons3jlj0EpYl9iCLTi9S7g_IXsvjrHcrmAK46phOyhwRGv2I7BCeQRR7k5N-vvFQE1scj3zB5fAJ3t_ZulRsNuz2kG7wgoJsNs68G5BAtD_noYNMI2xtnnfkpEfKxpi87AFC1_B5xPt2ltW-CVHk934q0iVaxtvg Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:15:33.819025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80b3167e7ad94627b239bf680217ff61"}]}] Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 3603342a11f14f3d9edd7dbcbf08d72d Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance c812772a-b68e-43af-aaa3-a872602e897a could not be found. Oct 05 14:15:33.820658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': 'c812772a-b68e-43af-aaa3-a872602e897a'} Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c812772a-b68e-43af-aaa3-a872602e897a could not be found. Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:15:33.821622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c812772a-b68e-43af-aaa3-a872602e897a could not be found. Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c812772a-b68e-43af-aaa3-a872602e897a could not be found. Oct 05 14:15:33.823134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:33.824515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Returning 404 to user: Instance c812772a-b68e-43af-aaa3-a872602e897a could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:15:33.824515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-19df3857-f145-4840-9636-29284f0b79db tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a" status: 404 len: 111 microversion: 2.1 time: 0.031020 Oct 05 14:15:33.824515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 293/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:33 2022] GET /compute/v2.1/servers/c812772a-b68e-43af-aaa3-a872602e897a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:15:33.834347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bfa5cdcb-9de5-4d34-bdeb-f3531bdac860 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '.version_select at 0x7f218d28ec10>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:33.854299 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bfa5cdcb-9de5-4d34-bdeb-f3531bdac860 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598333004" status: 202 len: 0 microversion: 2.1 time: 0.024603 Oct 05 14:15:33.854891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 268/561] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 14:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598333004 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 14:15:36.737326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:36.737820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:36.744518 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:36.744994 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:36.745635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:36.746136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:36.746586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:36.747004 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:36.773143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:15:36.846541 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5dcdf861-769e-47be-bb16-58a39538a6d3 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 204 len: 0 microversion: 2.1 time: 0.112663 Oct 05 14:15:36.847044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 294/562] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:15:36 2022] DELETE /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:15:36.855237 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:36.855975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:36.862463 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:36.862949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:36.863391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:36.864077 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:36.864542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:36.865246 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:37.022640 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:37.030596 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-72c50549-31ae-47f8-8c22-61ff22f363fe tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1508 microversion: 2.1 time: 0.179154 Oct 05 14:15:37.031232 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 269/563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:36 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:38.055781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:38.056503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:38.063321 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:38.063819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:38.064262 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:38.064976 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:38.065467 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:38.065901 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:38.196877 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:38.204542 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f6a9d4d1-7f5d-4394-b7e6-8d18a7724082 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1508 microversion: 2.1 time: 0.153608 Oct 05 14:15:38.205108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 295/564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:38 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:39.227513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:39.228119 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:39.234464 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:39.234944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:39.235377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:39.236062 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:39.236511 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:39.236933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:39.362255 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:39.370612 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c946e685-b758-40ed-9a27-8b18d35f35c9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 200 len: 1508 microversion: 2.1 time: 0.147452 Oct 05 14:15:39.371174 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 270/565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:39 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:39.632790 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-5ff74349-329e-4f48-8382-4f2336f11de6 req-9ec9cca2-6b98-41dd-9cbe-59652bfbd92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c131c2bc-ef43-42f0-90d5-671c67ae78b4", "name": "network-vif-deleted", "tag": "04cc93a2-faef-4af1-92a8-af294d38020e"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:39.643200 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5ff74349-329e-4f48-8382-4f2336f11de6 req-9ec9cca2-6b98-41dd-9cbe-59652bfbd92f service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:39.643771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5ff74349-329e-4f48-8382-4f2336f11de6 req-9ec9cca2-6b98-41dd-9cbe-59652bfbd92f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:39.644349 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-5ff74349-329e-4f48-8382-4f2336f11de6 req-9ec9cca2-6b98-41dd-9cbe-59652bfbd92f service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:39.657874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-5ff74349-329e-4f48-8382-4f2336f11de6 req-9ec9cca2-6b98-41dd-9cbe-59652bfbd92f service nova] Creating event network-vif-deleted:04cc93a2-faef-4af1-92a8-af294d38020e for instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 on hv-cinder-83587 Oct 05 14:15:39.663211 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-5ff74349-329e-4f48-8382-4f2336f11de6 req-9ec9cca2-6b98-41dd-9cbe-59652bfbd92f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Oct 05 14:15:39.663813 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 296/566] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:40.393283 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:40.393845 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: c131c2bc-ef43-42f0-90d5-671c67ae78b4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:40.400216 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:40.400731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:40.401176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:40.401891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:40.402350 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:40.402782 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:40.415697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] HTTP exception thrown: Instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 could not be found. Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Request method failure captured: Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 HTTP/1.1 Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCRux-cKlIsxHKons3jlj0EpYl9iCLTi9S7g_IXsvjrHcrmAK46phOyhwRGv2I7BCeQRR7k5N-vvFQE1scj3zB5fAJ3t_ZulRsNuz2kG7wgoJsNs68G5BAtD_noYNMI2xtnnfkpEfKxpi87AFC1_B5xPt2ltW-CVHk934q0iVaxtvg Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:15:40.417335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80b3167e7ad94627b239bf680217ff61"}]}] Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 3603342a11f14f3d9edd7dbcbf08d72d Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 could not be found. Oct 05 14:15:40.418847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'c131c2bc-ef43-42f0-90d5-671c67ae78b4'} Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 could not be found. Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:15:40.419727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 could not be found. Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 could not be found. Oct 05 14:15:40.421144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:15:40.422392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Returning 404 to user: Instance c131c2bc-ef43-42f0-90d5-671c67ae78b4 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:15:40.422392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e5416570-869a-4095-bc82-ea440ed343fa tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4" status: 404 len: 111 microversion: 2.1 time: 0.029377 Oct 05 14:15:40.422392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 271/567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:40 2022] GET /compute/v2.1/servers/c131c2bc-ef43-42f0-90d5-671c67ae78b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:15:40.428135 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:40.428716 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:40.434794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:40.435270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:40.435703 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:40.436382 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:40.436833 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:40.437280 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:40.461969 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:15:40.536077 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a00d63a3-a192-45e7-86a1-fd9ff16d826b tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 204 len: 0 microversion: 2.1 time: 0.112286 Oct 05 14:15:40.537268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 297/568] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:15:40 2022] DELETE /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:15:40.545242 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:40.545867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:40.552035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:40.553098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:40.553583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:40.554280 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:40.554743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:40.555170 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:40.683747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:40.691375 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-283c30cc-4032-4493-98e0-45bbf77ca0d5 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.149978 Oct 05 14:15:40.691928 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 272/569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:40 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:41.715242 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:41.715942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:41.722257 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:41.722739 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:41.723178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:41.724477 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:41.724936 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:41.725393 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:41.855737 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:41.863247 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-92f2a69e-88e7-49c0-b944-8717523f1986 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.152276 Oct 05 14:15:41.863807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 298/570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:41 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:42.886136 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:42.886751 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:42.893136 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:42.893657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:42.894093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:42.894787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:42.895242 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:42.895667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:43.018774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:43.026357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0081a06a-8eb8-43a8-9f97-fa1b6be5ceb4 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.144093 Oct 05 14:15:43.026913 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 273/571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:42 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:44.049735 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:44.050348 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:44.057250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:44.057977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:44.058165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:44.058869 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:44.059309 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:44.059728 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:44.249627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603342a11f14f3d9edd7dbcbf08d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b3167e7ad94627b239bf680217ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:44.257714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-12c6e1e1-069a-4777-b128-53cb6e808ba9 tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 200 len: 1521 microversion: 2.1 time: 0.211803 Oct 05 14:15:44.258519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 299/572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:44 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:15:44.389050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-d2b661b5-1e84-44f1-b580-314ca420a266 req-7971ddd5-e446-4b25-99d8-346c37ce747a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6400a5f5-5a07-4b6d-8457-0856fddfc8cf", "name": "network-vif-deleted", "tag": "54549e69-de73-4ad3-be2a-5c89b60c108e"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:44.399606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d2b661b5-1e84-44f1-b580-314ca420a266 req-7971ddd5-e446-4b25-99d8-346c37ce747a service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:44.400085 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d2b661b5-1e84-44f1-b580-314ca420a266 req-7971ddd5-e446-4b25-99d8-346c37ce747a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:44.400514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d2b661b5-1e84-44f1-b580-314ca420a266 req-7971ddd5-e446-4b25-99d8-346c37ce747a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:44.413988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-d2b661b5-1e84-44f1-b580-314ca420a266 req-7971ddd5-e446-4b25-99d8-346c37ce747a service nova] Creating event network-vif-deleted:54549e69-de73-4ad3-be2a-5c89b60c108e for instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf on hv-cinder-83587 Oct 05 14:15:44.418882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-d2b661b5-1e84-44f1-b580-314ca420a266 req-7971ddd5-e446-4b25-99d8-346c37ce747a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Oct 05 14:15:44.419461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 274/573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:15:45.281409 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:45.282017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] [instance: 6400a5f5-5a07-4b6d-8457-0856fddfc8cf] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:45.288483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:45.289013 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:45.289495 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:45.290178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:45.290628 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:45.291048 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:45.304893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] HTTP exception thrown: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf could not be found. Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Request method failure captured: Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf HTTP/1.1 Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCRux-cKlIsxHKons3jlj0EpYl9iCLTi9S7g_IXsvjrHcrmAK46phOyhwRGv2I7BCeQRR7k5N-vvFQE1scj3zB5fAJ3t_ZulRsNuz2kG7wgoJsNs68G5BAtD_noYNMI2xtnnfkpEfKxpi87AFC1_B5xPt2ltW-CVHk934q0iVaxtvg Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:15:45.306533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80b3167e7ad94627b239bf680217ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80b3167e7ad94627b239bf680217ff61"}]}] Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 80b3167e7ad94627b239bf680217ff61 Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468037312 Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 3603342a11f14f3d9edd7dbcbf08d72d Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468037312-project Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf could not be found. Oct 05 14:15:45.308075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '6400a5f5-5a07-4b6d-8457-0856fddfc8cf'} Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf could not be found. Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:15:45.308896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf could not be found. Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf could not be found. Oct 05 14:15:45.310091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:15:45.311166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] Returning 404 to user: Instance 6400a5f5-5a07-4b6d-8457-0856fddfc8cf could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:15:45.311166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7df10405-e175-43e0-9be0-fbf5a0905bcd tempest-ServerRescueNegativeTestJSON-468037312 tempest-ServerRescueNegativeTestJSON-468037312-project] 10.222.0.16 "GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf" status: 404 len: 111 microversion: 2.1 time: 0.030653 Oct 05 14:15:45.311166 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 300/574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:15:45 2022] GET /compute/v2.1/servers/6400a5f5-5a07-4b6d-8457-0856fddfc8cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:15:49.004379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:49.004958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:49.006951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:49.012220 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:49.012700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:49.013186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:49.013941 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:49.014393 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:49.014815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:49.039682 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2df3c92f-bed2-43dd-8d9f-86fd5d16e8e5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/ips" status: 200 len: 149 microversion: 2.20 time: 0.040123 Oct 05 14:15:49.040459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 275/575] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 5 14:15:48 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:15:51.451364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:15:51.451932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:51.458888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:51.459686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:51.460342 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:51.461050 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:51.461533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:51.461960 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:51.487523 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lazy-loading 'flavor' on Instance uuid 91aad4a0-81fb-4eb0-9a78-29e59b85923c {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:15:51.700514 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f424cf35-aa60-4a86-a95c-e930546382d5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/action" status: 202 len: 0 microversion: 2.20 time: 0.253107 Oct 05 14:15:51.701352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 301/576] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 14:15:51 2022] POST /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:15:51.709563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:51.710845 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:51.717736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:51.718269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:51.718737 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:51.719500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:51.720132 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:51.720822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:51.945596 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:51.954687 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:51.956464 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:51.957699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1589cd84-1bc8-4e69-8701-b1a9a5a5bc86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.252170 Oct 05 14:15:51.958452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 276/577] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:51 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:52.983887 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:52.984587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:52.991659 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:52.992141 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:52.992577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:52.993285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:52.993742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:52.994165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:53.164199 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:53.172507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:53.174683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:53.176073 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9e3f13fd-e0f4-478f-b394-ccd70006f3a4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.196818 Oct 05 14:15:53.185687 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 302/578] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:52 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:54.200848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:54.201479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:54.207907 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:54.208380 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:54.208809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:54.209631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:54.210611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:54.211029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:54.594868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:54.603802 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:54.605383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:54.606635 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5ef515ee-9bf6-4ccb-b41a-e9069a056688 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.409580 Oct 05 14:15:54.607183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 277/579] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:54 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:55.631264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:55.631900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:55.634272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:55.639686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:55.640183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:55.640654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:55.641451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:55.642083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:55.642460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:55.781966 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:55.792141 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:55.793744 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:55.794924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-58c417cd-93c4-48e2-b380-fa31687421ee tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.167505 Oct 05 14:15:55.795598 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 303/580] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:55 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:56.822030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:56.822659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:56.829552 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:56.830052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:56.830488 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:56.831200 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:56.831655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:56.832082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:56.961446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:56.969428 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:56.970964 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:56.972010 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8ae193e0-ebd7-4283-a8ad-80f89463ff2e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.154670 Oct 05 14:15:56.972566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 278/581] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:56 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:57.997816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:57.998537 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:58.005008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:58.005761 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:58.006207 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:58.006908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:58.007370 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:58.007796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:58.142637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:58.150720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:58.152185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:58.153368 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1d407855-a85f-4131-80c6-89d6d04821b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.159379 Oct 05 14:15:58.153933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 304/582] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:57 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:15:59.179193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:15:59.179808 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:15:59.186223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:59.186712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:59.187152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:59.187839 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:15:59.188297 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:15:59.188721 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:15:59.326427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:59.336230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:59.337961 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:15:59.339127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-24218d21-4f08-4b60-93d2-7686024c127e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.163843 Oct 05 14:15:59.339702 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 279/583] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:15:59 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:00.363830 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:00.364888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:00.372066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:00.372680 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:00.373431 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:00.374215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:00.374873 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:00.375404 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:00.394781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:00.530710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:00.538889 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:00.540349 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:00.541754 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-95f2879a-a482-4692-8248-0497625f13c3 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.181843 Oct 05 14:16:00.542640 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 305/584] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:00 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:01.567429 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:01.568599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:01.575075 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:01.575749 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:01.576353 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:01.577453 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:01.578402 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:01.579134 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:01.583452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=70 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:01.708110 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:01.716228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:01.717698 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:01.718862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-598b5249-176f-4d6a-9873-6fcba53c0389 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.155472 Oct 05 14:16:01.719420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 280/585] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:01 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:01.752989 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1947290307", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "networks": [{"uuid": "3beb1387-ae89-4a2a-9e23-ea34953c3a45"}]}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:01.805820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] validate_networks() for [('3beb1387-ae89-4a2a-9e23-ea34953c3a45', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:16:02.152360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:16:02.152785 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:16:02.153280 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:16:02.153692 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:16:02.154104 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:16:02.163722 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:02.164263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:02.164639 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:02.165398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:02.165860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:02.166315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:02.182567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Getting quotas for project 8ad97f408ae04ed294a9144f4c5eb69c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:16:02.186574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Getting quotas for user 7b2a3a989e874a3b9fe0b216207d8292 and project 8ad97f408ae04ed294a9144f4c5eb69c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:16:02.197775 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:16:02.200041 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:16:02.246276 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-eab4dd7c-f754-4f55-a518-85e8022d6ecd tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607731 Oct 05 14:16:02.246915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 306/586] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:16:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 14:16:02.258158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d8f7ef67-cd3c-46d0-810a-befc02657bca tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:02.258775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d8f7ef67-cd3c-46d0-810a-befc02657bca tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:02.317427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d8f7ef67-cd3c-46d0-810a-befc02657bca tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:02.324301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d8f7ef67-cd3c-46d0-810a-befc02657bca tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1214 microversion: 2.1 time: 0.070054 Oct 05 14:16:02.324869 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 281/587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:02 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:02.744658 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:02.745420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:02.751693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:02.752250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:02.752751 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:02.753463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:02.754048 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:02.754337 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:02.888506 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:02.897188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:02.898689 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:02.899852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-baa8ab26-747a-404a-bcd6-d0384eb12d87 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1740 microversion: 2.20 time: 0.159506 Oct 05 14:16:02.900413 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 307/588] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:02 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:16:03.346768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:03.347313 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:03.354453 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:03.354945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:03.355389 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:03.356079 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:03.356534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:03.356957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:03.419442 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:03.426847 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2e015bb1-3c64-4e47-aafc-65e8b20bcb6c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1266 microversion: 2.1 time: 0.083997 Oct 05 14:16:03.427429 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 282/589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:03 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:03.925922 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:03.926544 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:03.932860 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:03.933383 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:03.933825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:03.934526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:03.934984 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:03.935411 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:04.126547 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:04.136046 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:04.137517 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:04.138681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d297f61a-ce6c-4221-86e3-f094706fe3db tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1740 microversion: 2.20 time: 0.216777 Oct 05 14:16:04.139232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 308/590] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:03 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:04.452789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:04.455637 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:04.466949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:04.467437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:04.468038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:04.469112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:04.469851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:04.470279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:04.629446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:04.637617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e3d36fb5-c6cb-4efe-ae04-056015660f0c tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.191312 Oct 05 14:16:04.638805 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 283/591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:04 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:05.051113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-a4b2a726-92e8-4e27-b923-a0f09e34dbe9 req-6bfb90c3-f09e-450c-8bfb-0558ec388fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986f4639-1911-4b57-b25a-06fe963fb97c", "tag": "4fcc0f0a-a0ea-4d12-a6df-6c44ddda6af0"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:05.070596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a4b2a726-92e8-4e27-b923-a0f09e34dbe9 req-6bfb90c3-f09e-450c-8bfb-0558ec388fbe service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.071343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a4b2a726-92e8-4e27-b923-a0f09e34dbe9 req-6bfb90c3-f09e-450c-8bfb-0558ec388fbe service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.071808 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a4b2a726-92e8-4e27-b923-a0f09e34dbe9 req-6bfb90c3-f09e-450c-8bfb-0558ec388fbe service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.085188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-a4b2a726-92e8-4e27-b923-a0f09e34dbe9 req-6bfb90c3-f09e-450c-8bfb-0558ec388fbe service nova] Creating event network-changed:4fcc0f0a-a0ea-4d12-a6df-6c44ddda6af0 for instance 986f4639-1911-4b57-b25a-06fe963fb97c on hv-cinder-83587 Oct 05 14:16:05.090765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-a4b2a726-92e8-4e27-b923-a0f09e34dbe9 req-6bfb90c3-f09e-450c-8bfb-0558ec388fbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045392 Oct 05 14:16:05.091581 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 309/592] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:05.164738 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:05.166450 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:05.176176 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.176851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.177339 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.178583 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.179049 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.179482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.346190 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:05.355763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:05.358047 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:05.359537 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c4abca9e-fb82-48c2-bc52-8d68debf0b9c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.199170 Oct 05 14:16:05.360439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 284/593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:05 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:05.600204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:05.601032 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:05.607401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.607955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.608401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.609107 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.609597 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.610271 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.636072 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7f78c3db-a43d-4cc9-a6ac-97ed5e305c4e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/ips" status: 200 len: 149 microversion: 2.1 time: 0.040185 Oct 05 14:16:05.637022 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 310/594] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:16:05 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:16:05.668022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:05.669219 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:05.675537 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.676208 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.676803 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.677674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:05.678809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:05.679384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:05.846612 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:05.856211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-db37c2ea-2116-4aca-bfa4-dc43eea90439 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.194918 Oct 05 14:16:05.875979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 285/595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:05 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:06.230797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-d0767f35-ef3b-4024-85f8-0b961dd1002b req-1c449d2b-df9b-4bd1-82e5-8c3cd01f8fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "name": "network-vif-plugged", "status": "completed", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:06.251655 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d0767f35-ef3b-4024-85f8-0b961dd1002b req-1c449d2b-df9b-4bd1-82e5-8c3cd01f8fe3 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:06.252397 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d0767f35-ef3b-4024-85f8-0b961dd1002b req-1c449d2b-df9b-4bd1-82e5-8c3cd01f8fe3 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:06.253128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d0767f35-ef3b-4024-85f8-0b961dd1002b req-1c449d2b-df9b-4bd1-82e5-8c3cd01f8fe3 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:06.273766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-d0767f35-ef3b-4024-85f8-0b961dd1002b req-1c449d2b-df9b-4bd1-82e5-8c3cd01f8fe3 service nova] Creating event network-vif-plugged:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:16:06.282252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-d0767f35-ef3b-4024-85f8-0b961dd1002b req-1c449d2b-df9b-4bd1-82e5-8c3cd01f8fe3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054751 Oct 05 14:16:06.288284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 311/596] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:06.392611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:06.393501 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:06.400369 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:06.400853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:06.401385 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:06.402081 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:06.402530 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:06.402949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:06.570484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:06.583757 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:06.586335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:06.587727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-77feb8da-230a-4361-8d4e-e3def26bc3ba tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.203650 Oct 05 14:16:06.588287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 286/597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:06 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:06.883497 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:06.884453 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:06.892324 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:06.893053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:06.893718 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:06.894478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:06.894931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:06.895349 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:07.047421 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:07.059582 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0f39dd76-7372-411d-aa32-8fb3575218fa tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.179010 Oct 05 14:16:07.060526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 312/598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:06 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:07.094144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:07.097657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:07.105429 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:07.105925 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:07.106369 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:07.107082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:07.107542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:07.107973 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:07.398916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-343e0572-d9d2-45aa-9711-9909c6754475 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308417 Oct 05 14:16:07.400182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 287/599] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:16:07 2022] POST /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:07.613183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:07.613835 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:07.621268 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:07.621668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:07.622107 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:07.622821 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:07.623270 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:07.623695 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:07.805330 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:07.813814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:07.815392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:07.816632 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-52f9a3af-cd18-4479-bdc0-662ab12d2bf6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.207438 Oct 05 14:16:07.817180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 313/600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:07 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:08.087279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:08.088342 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:08.095588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:08.096765 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:08.097482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:08.098352 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:08.099038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:08.099714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:08.272667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:08.280988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7a204471-a24d-4722-9535-6d9989d665ba tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.201282 Oct 05 14:16:08.282604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 288/601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:08 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:08.843645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:08.844852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:08.851576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:08.851993 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:08.852636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:08.853358 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:08.853815 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:08.854244 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.006888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:09.015609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:09.017203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:09.018448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3e0a445c-8c60-4b01-9853-27009a21165f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.179374 Oct 05 14:16:09.019427 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 314/602] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:08 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:09.306406 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:09.307712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:09.314614 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:09.315358 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:09.315882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.316678 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:09.317205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:09.317725 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.454087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:09.462675 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-277456b3-3df2-46e5-a8a3-2ad688d1344e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.161089 Oct 05 14:16:09.463482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 289/603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:09 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:09.682179 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:09.684520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:09.691206 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:09.691694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:09.692137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.692837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:09.693845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:09.694443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.790084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Invalid volume: volume eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f is already attached to instances: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: POST /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments HTTP/1.1 Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 74 Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:16:09.791817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {"volumeAttachment": {"volumeId": "eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f"}} Oct 05 14:16:09.793172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Invalid volume: volume eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f is already attached to instances: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'server_id': 'e9a8c159-6cf1-4a0e-87cb-a0035fe3730a', 'body': {'volumeAttachment': {'volumeId': 'eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f'}}} Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f is already attached to instances: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:09.794007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f is already attached to instances: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:09.795182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f is already attached to instances: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 400 to user: Invalid volume: volume eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f is already attached to instances: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:16:09.796369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-57ab5570-4cbc-401c-9e89-709c692c60c9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115062 Oct 05 14:16:09.801131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 315/604] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:16:09 2022] POST /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:16:09.867239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:09.867731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:09.874373 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:09.875152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:09.875808 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.876522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:09.876977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:09.877437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:09.962610 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'services' on Instance uuid e9a8c159-6cf1-4a0e-87cb-a0035fe3730a {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:16:10.049914 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:10.051216 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:10.065909 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7529e485-3be5-47cc-8b2b-3dbe97814b03 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments/eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f" status: 202 len: 0 microversion: 2.1 time: 0.202044 Oct 05 14:16:10.066799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.067055 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 290/605] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:16:09 2022] DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments/eb9974b7-cd6b-4a43-b2f0-b9d97ad0270f => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:16:10.067852 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.068908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.069747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.070503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.073796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.080850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:10.087180 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:10.094782 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.095650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.097775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.099716 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.101036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.101581 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.196883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-180c3052-01e2-4156-bc1c-da908e087156 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124588 Oct 05 14:16:10.197494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 291/606] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:16:10 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:10.276999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:10.289004 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:10.294345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:10.295621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-38c8125b-563a-4ea3-ae7c-842240fae833 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.256483 Oct 05 14:16:10.310241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 316/607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:10 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:10.328669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-73bdb859-6fe8-4135-ae70-da18b78192da req-c2bad3b1-5e4b-48f5-9685-8d7f7e3114c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986f4639-1911-4b57-b25a-06fe963fb97c", "name": "network-vif-plugged", "status": "completed", "tag": "4fcc0f0a-a0ea-4d12-a6df-6c44ddda6af0"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:10.340293 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-73bdb859-6fe8-4135-ae70-da18b78192da req-c2bad3b1-5e4b-48f5-9685-8d7f7e3114c6 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.340863 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-73bdb859-6fe8-4135-ae70-da18b78192da req-c2bad3b1-5e4b-48f5-9685-8d7f7e3114c6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.341576 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-73bdb859-6fe8-4135-ae70-da18b78192da req-c2bad3b1-5e4b-48f5-9685-8d7f7e3114c6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.354377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-73bdb859-6fe8-4135-ae70-da18b78192da req-c2bad3b1-5e4b-48f5-9685-8d7f7e3114c6 service nova] Creating event network-vif-plugged:4fcc0f0a-a0ea-4d12-a6df-6c44ddda6af0 for instance 986f4639-1911-4b57-b25a-06fe963fb97c on hv-cinder-83587 Oct 05 14:16:10.360011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-73bdb859-6fe8-4135-ae70-da18b78192da req-c2bad3b1-5e4b-48f5-9685-8d7f7e3114c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035362 Oct 05 14:16:10.361195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 292/608] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:10.486494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:10.487503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:10.496487 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.496975 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.497603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.498492 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:10.499104 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:10.499528 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:10.742764 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:10.753917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6a3f8918-8b0b-4166-a2b4-df7ee7687f3a tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.271379 Oct 05 14:16:10.754753 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 317/609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:10 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:11.210778 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:11.213142 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:11.222695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.223178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.223785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.225054 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.225539 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.225969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.266349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3920e0df-1749-417a-8186-2cd8ee06d998 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060333 Oct 05 14:16:11.272396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 293/610] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:16:11 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:16:11.324992 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:11.325659 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:11.335912 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.336397 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.337573 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.338830 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.341501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.343001 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.354003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:11.354524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:11.362918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.363403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.364011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.366165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.366823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.367247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.396404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:16:11.473003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:11.509059 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:11.510997 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6717193f-6173-4db7-9042-6ec8c4af2dce tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 204 len: 0 microversion: 2.1 time: 0.161099 Oct 05 14:16:11.512023 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 294/611] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:16:11 2022] DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 14:16:11.520795 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:11.521492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:11.522220 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:11.523331 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:11.524787 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-950debf7-746f-43f5-a5e1-ffe348920d86 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.205215 Oct 05 14:16:11.525368 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 318/612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:11 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:11.528932 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.529479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.529895 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.530606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.531066 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.531548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.689208 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:11.697775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2162a4e8-33a4-4ed0-8f05-f357114b2f6e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1679 microversion: 2.1 time: 0.180978 Oct 05 14:16:11.698838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 295/613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:11 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:11.781285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:11.782251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:11.789576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.789865 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.790404 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:11.791205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:11.791756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:11.792432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:12.173619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:12.178376 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:12.189909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ee519f78-2e3f-444f-92cb-b92390c31332 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1314 microversion: 2.1 time: 0.416023 Oct 05 14:16:12.190866 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 319/614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:11 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:12.550854 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:12.552244 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:12.555554 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:12.561374 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:12.561998 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:12.562437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:12.563130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:12.563849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:12.564270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:12.705300 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:12.715147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:12.716773 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:12.718080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a2e1d5a1-394c-4050-9917-566af820f44f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.171135 Oct 05 14:16:12.722443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:12.723636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:12.731062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=6 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:12.733622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 296/615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:12 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:12.739075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:12.739829 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:12.740827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:12.741596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:12.742058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:12.742484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:12.896899 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:12.905506 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-36beecb7-218d-41ce-9794-4bfd329045d5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1679 microversion: 2.1 time: 0.187259 Oct 05 14:16:12.906894 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 320/616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:12 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:13.213730 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:13.214543 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:13.220626 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:13.221109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:13.221582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:13.222292 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:13.222747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:13.223167 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:13.364208 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:13.373073 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2c3dea3c-a80b-462a-ae73-73ce4b20f579 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1498 microversion: 2.1 time: 0.163144 Oct 05 14:16:13.377272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 297/617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:13 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:13.744742 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:13.745985 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:13.757672 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:13.759847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:13.760460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:13.761398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:13.763138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:13.763593 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:13.930079 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:13.930999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:13.939706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:13.943377 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:13.943918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:13.945302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:13.945835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:13.946322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:14.084169 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:14.094783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:14.103682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:14.105377 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-01dec5ac-519a-4d8f-a52e-460d98907ed5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1735 microversion: 2.20 time: 0.366061 Oct 05 14:16:14.122674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 321/618] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:13 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1735 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:14.145432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:14.155645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-42aebd66-af8d-46ba-8827-6dacd401e6a4 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1679 microversion: 2.1 time: 0.229525 Oct 05 14:16:14.156334 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 298/619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:13 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:16:14.661574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-cf971f8d-bc3a-4192-8633-769f1de2d90c req-620cf239-fe20-4209-ac76-b7a418b68134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a8c159-6cf1-4a0e-87cb-a0035fe3730a", "name": "network-vif-deleted", "tag": "ae45347c-954e-4d4c-9e2c-21e0273aa89d"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:14.672439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-cf971f8d-bc3a-4192-8633-769f1de2d90c req-620cf239-fe20-4209-ac76-b7a418b68134 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:14.673324 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-cf971f8d-bc3a-4192-8633-769f1de2d90c req-620cf239-fe20-4209-ac76-b7a418b68134 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:14.674002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-cf971f8d-bc3a-4192-8633-769f1de2d90c req-620cf239-fe20-4209-ac76-b7a418b68134 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:14.687142 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-cf971f8d-bc3a-4192-8633-769f1de2d90c req-620cf239-fe20-4209-ac76-b7a418b68134 service nova] Creating event network-vif-deleted:ae45347c-954e-4d4c-9e2c-21e0273aa89d for instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a on hv-cinder-83587 Oct 05 14:16:14.692019 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-cf971f8d-bc3a-4192-8633-769f1de2d90c req-620cf239-fe20-4209-ac76-b7a418b68134 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034276 Oct 05 14:16:14.692727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 322/620] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:15.142498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:15.143929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:15.155888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.156464 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.156967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.157795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.158779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.159269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.185024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:15.186556 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:15.195577 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.196289 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.196922 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.197814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.198564 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.199396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.250653 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.251091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.251528 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.251980 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'fault' on Instance uuid e9a8c159-6cf1-4a0e-87cb-a0035fe3730a {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:16:15.304132 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:15.304809 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:15.312296 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:15.313105 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3f2f6a0b-c19e-48b2-8f60-5e0182403ad5 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 200 len: 1330 microversion: 2.1 time: 0.136385 Oct 05 14:16:15.317277 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:15.317552 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 323/621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:15 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:16:15.317734 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-62171b19-398a-4887-a745-16887ed2c54a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1717 microversion: 2.20 time: 0.176256 Oct 05 14:16:15.317734 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 299/622] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:15 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:15.871495 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:15.871996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:15.878165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.878703 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.879147 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.879848 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.880305 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.880765 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:15.906147 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:16:15.909313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:15.983162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-128069cc-307b-4ca8-b4b9-55b92d4ebd2e tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "DELETE /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 204 len: 0 microversion: 2.1 time: 0.115239 Oct 05 14:16:15.983752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 324/623] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:16:15 2022] DELETE /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:16:15.992634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:15.993266 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:15.999056 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:15.999534 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:15.999959 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:16.000644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:16.001091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:16.001540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:16.226931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:16.234882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-00509bdc-a497-44af-8f30-da6fa0b504f3 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1504 microversion: 2.1 time: 0.246875 Oct 05 14:16:16.235439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 300/624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:15 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:16.337632 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:16.338392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:16.339432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:16.340045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:16.344821 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:16.345355 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:16.345799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:16.345911 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:16.346285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:16.346500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:16.346725 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:16.346960 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:16.347392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:16.347507 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:16.347857 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:16.348284 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:16.360720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a HTTP/1.1 Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:16:16.362379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:16:16.363740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': 'e9a8c159-6cf1-4a0e-87cb-a0035fe3730a'} Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:16:16.364721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:16:16.366484 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:16.367607 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:16:16.367607 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-abf43037-fad8-4e3b-86b9-7a901fabe712 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 404 len: 111 microversion: 2.1 time: 0.030554 Oct 05 14:16:16.367607 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 325/625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:16 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:16:16.373018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-60a37288-f070-4805-9dc4-b6c5f91fe9da tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '.version_select at 0x7f218d1d6d30>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:16.392397 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-60a37288-f070-4805-9dc4-b6c5f91fe9da tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-926446023" status: 202 len: 0 microversion: 2.1 time: 0.022794 Oct 05 14:16:16.392989 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 326/626] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 14:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-926446023 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:16:16.477771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:16.486209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:16.487973 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:16.489141 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-67311725-5df7-47df-8de8-931e4e80b485 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1717 microversion: 2.20 time: 0.153431 Oct 05 14:16:16.490603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 301/627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:16 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:16:16.988054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9dbb6b10-6001-43fa-a87a-13ec63ac8e70 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: .version_select at 0x7f218d100ee0>, body: {"keypair": {"name": "tempest-keypair-1097402380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqqx+RZcnmBfzkz3folyVNgaSSbaThUAtX/613D6IRseA6ALByAGS+aWUEaoi49Gsvx6pHYk1jYvaLoR57SBsvjbLeys9cSAufgUZqZKHXuY75aA4gNRcHsEuTZSVKhQw=="}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:17.004085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-9dbb6b10-6001-43fa-a87a-13ec63ac8e70 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:16:17.007925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-9dbb6b10-6001-43fa-a87a-13ec63ac8e70 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:16:17.029161 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9dbb6b10-6001-43fa-a87a-13ec63ac8e70 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045299 Oct 05 14:16:17.029756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 327/628] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:16:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:17.261520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:17.262183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:17.268605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:17.269087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:17.269621 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:17.270350 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:17.270796 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:17.271268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:17.465895 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:17.475775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b5c4a68f-d37f-4340-bdba-59fc0b4133f9 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1504 microversion: 2.1 time: 0.219881 Oct 05 14:16:17.476384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 302/629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:17 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:17.515839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:17.516579 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:17.522414 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:17.522920 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:17.523340 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:17.524033 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:17.524491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:17.524916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:17.751667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:17.759832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:17.761473 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:17.763687 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-26bf0899-ef71-45e7-8bce-b5e12a5ad912 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1717 microversion: 2.20 time: 0.252391 Oct 05 14:16:17.764336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 328/630] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:17 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1717 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:18.238619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-e5a9bd12-9bf6-4736-8faf-bcafd8085bff req-241bba9e-39e2-4aac-87e1-1cbce40f6d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "name": "network-vif-unplugged", "status": "completed", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:18.250362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e5a9bd12-9bf6-4736-8faf-bcafd8085bff req-241bba9e-39e2-4aac-87e1-1cbce40f6d96 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:18.251012 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e5a9bd12-9bf6-4736-8faf-bcafd8085bff req-241bba9e-39e2-4aac-87e1-1cbce40f6d96 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:18.251757 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e5a9bd12-9bf6-4736-8faf-bcafd8085bff req-241bba9e-39e2-4aac-87e1-1cbce40f6d96 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:18.263668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-e5a9bd12-9bf6-4736-8faf-bcafd8085bff req-241bba9e-39e2-4aac-87e1-1cbce40f6d96 service nova] Creating event network-vif-unplugged:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:16:18.268915 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-e5a9bd12-9bf6-4736-8faf-bcafd8085bff req-241bba9e-39e2-4aac-87e1-1cbce40f6d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035041 Oct 05 14:16:18.269647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 303/631] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:18.424039 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-935301511", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acdcb2d2-e854-4a1a-88ab-e50e826e09dc"}], "security_groups": [{"name": "tempest-securitygroup--564332164"}], "key_name": "tempest-keypair-1097402380", "user_data": "}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:18.500470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:18.501316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:18.508331 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:18.508820 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:18.509497 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:18.510202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:18.510656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:18.511082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:18.656127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:18.664105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-20a81616-8301-4575-acf9-5800d57cea6d tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1504 microversion: 2.1 time: 0.167862 Oct 05 14:16:18.664672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 304/632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:18 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:16:18.689029 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] validate_networks() for [('acdcb2d2-e854-4a1a-88ab-e50e826e09dc', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:16:18.791783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:18.792388 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:18.798277 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:18.798758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:18.799192 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:18.799872 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:18.800322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:18.800744 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:18.960495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:18.968755 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:18.970229 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:18.971433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e94e244b-7e3e-4670-b9ed-60b339ee59a2 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1720 microversion: 2.20 time: 0.183556 Oct 05 14:16:18.971994 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 305/633] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:18 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:16:18.998483 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "274faf2a-cb80-4a20-a126-d6146d4beebf"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:19.000957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:19.006949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.007443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.007885 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.008579 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.009040 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.009499 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.259313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:16:19.259951 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:16:19.260663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:16:19.261399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:16:19.261951 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:16:19.273134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.273917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.274443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.275237 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.275748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.276365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.282799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7f33d3a8-b78f-44e8-8db8-0ab9082de7f7 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288214 Oct 05 14:16:19.283415 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 306/634] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 5 14:16:18 2022] POST /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 14:16:19.302108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:16:19.306300 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Getting quotas for user 5fca6a15a17c423393582da43abec450 and project b3297ab419b04e7faf1738e64ab28c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:16:19.318143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:16:19.320549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:16:19.333132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:19.375360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-04e50bd5-a8e5-4492-9787-f8d71c727397 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.955524 Oct 05 14:16:19.377284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 329/635] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:16:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:16:19.387992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e35f3b87-c412-4bac-a52d-6e1913f0471a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:19.388745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e35f3b87-c412-4bac-a52d-6e1913f0471a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:19.394131 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:19.470946 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-173d7439-694f-43e8-80b8-5d0874e74bd0 req-f7ccba70-1ae7-41a7-82e0-6fa0faa4a774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986f4639-1911-4b57-b25a-06fe963fb97c", "name": "network-vif-deleted", "tag": "4fcc0f0a-a0ea-4d12-a6df-6c44ddda6af0"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:19.482204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-173d7439-694f-43e8-80b8-5d0874e74bd0 req-f7ccba70-1ae7-41a7-82e0-6fa0faa4a774 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.483399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-173d7439-694f-43e8-80b8-5d0874e74bd0 req-f7ccba70-1ae7-41a7-82e0-6fa0faa4a774 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.484031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-173d7439-694f-43e8-80b8-5d0874e74bd0 req-f7ccba70-1ae7-41a7-82e0-6fa0faa4a774 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.486754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e35f3b87-c412-4bac-a52d-6e1913f0471a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:19.497867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-173d7439-694f-43e8-80b8-5d0874e74bd0 req-f7ccba70-1ae7-41a7-82e0-6fa0faa4a774 service nova] Creating event network-vif-deleted:4fcc0f0a-a0ea-4d12-a6df-6c44ddda6af0 for instance 986f4639-1911-4b57-b25a-06fe963fb97c on hv-cinder-83587 Oct 05 14:16:19.498745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e35f3b87-c412-4bac-a52d-6e1913f0471a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1241 microversion: 2.1 time: 0.114730 Oct 05 14:16:19.500559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 307/636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:19 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:19.506244 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-173d7439-694f-43e8-80b8-5d0874e74bd0 req-f7ccba70-1ae7-41a7-82e0-6fa0faa4a774 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048971 Oct 05 14:16:19.507311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 330/637] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:16:19.509928 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:19.510696 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:19.521858 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.522744 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.523186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.524500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.524968 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.525525 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.690367 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:19.691065 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:19.698008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.698541 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.698968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.699649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.700097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.700520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.736592 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.737129 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.737813 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.738491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lazy-loading 'fault' on Instance uuid 986f4639-1911-4b57-b25a-06fe963fb97c {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:16:19.757785 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:INSERT=6,nova_cell1:SELECT=89,nova_cell1:UPDATE=5 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:19.789556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-abea75be-4b06-4297-bdd5-ffa059458354 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-volume_attachments/274faf2a-cb80-4a20-a126-d6146d4beebf" status: 202 len: 0 microversion: 2.20 time: 0.287235 Oct 05 14:16:19.790344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 308/638] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 5 14:16:19 2022] DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-volume_attachments/274faf2a-cb80-4a20-a126-d6146d4beebf => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:16:19.797136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2a3a989e874a3b9fe0b216207d8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad97f408ae04ed294a9144f4c5eb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:19.805478 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1e3cc16a-26d9-44ed-97ff-be86471df66f tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 200 len: 1304 microversion: 2.1 time: 0.120919 Oct 05 14:16:19.806141 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 331/639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:19 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:19.854696 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:19.855298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:19.861146 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.861670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.862113 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.862803 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.863262 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.863685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.908379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120646) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 14:16:19.980126 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d6bb2fe1-e95c-44e1-9de9-00151bd196b4 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "POST /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/action" status: 202 len: 0 microversion: 2.20 time: 0.129296 Oct 05 14:16:19.980912 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 309/640] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 14:16:19 2022] POST /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:16:19.989074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:19.990623 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:19.997025 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:19.997559 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:19.998182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:19.999407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:20.000051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:20.000639 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:20.155136 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:20.163878 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:20.165584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:20.167069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bd9ec1b5-8844-4f21-9f05-30465ebb521f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1668 microversion: 2.20 time: 0.182028 Oct 05 14:16:20.177917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 332/641] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:19 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:16:20.523508 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:20.524431 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:20.530648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:20.531261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:20.531806 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:20.532611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:20.533170 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:20.533825 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:20.615170 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:20.623333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3e8aeed4-8095-4afb-8f83-c418d69707a0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1301 microversion: 2.1 time: 0.104311 Oct 05 14:16:20.624134 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 310/642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:20 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:20.829887 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:20.830499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] [instance: 986f4639-1911-4b57-b25a-06fe963fb97c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:20.837670 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:20.838153 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:20.838587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:20.840172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:20.840635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:20.841053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:20.854983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] HTTP exception thrown: Instance 986f4639-1911-4b57-b25a-06fe963fb97c could not be found. Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Request method failure captured: Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c HTTP/1.1 Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZGguuU5fp0GwlitA2g9pTCUYU4-aLldHqLhmrN3XwuJProbyKSPZ-CDf2GEZEiwfR9D2UPS2XuHQzed2O2KydwSADJltXCDQjggTxvIlBkGbtxQ3faJKFKFIbpKv83Dfj2-9eTW5ELSPDzQ84GQrnpFaothJWnDFKCEt_ceoG0USrw Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 8ad97f408ae04ed294a9144f4c5eb69c Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-VolumesActionsTest-1082936294 Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:16:20.856665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ad97f408ae04ed294a9144f4c5eb69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ad97f408ae04ed294a9144f4c5eb69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ad97f408ae04ed294a9144f4c5eb69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ad97f408ae04ed294a9144f4c5eb69c"}]}] Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-VolumesActionsTest-1082936294 Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 8ad97f408ae04ed294a9144f4c5eb69c Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-VolumesActionsTest-1082936294 Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-VolumesActionsTest-1082936294-project Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 7b2a3a989e874a3b9fe0b216207d8292 Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-VolumesActionsTest-1082936294-project Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 986f4639-1911-4b57-b25a-06fe963fb97c could not be found. Oct 05 14:16:20.858310 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '986f4639-1911-4b57-b25a-06fe963fb97c'} Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986f4639-1911-4b57-b25a-06fe963fb97c could not be found. Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:16:20.862634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986f4639-1911-4b57-b25a-06fe963fb97c could not be found. Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986f4639-1911-4b57-b25a-06fe963fb97c could not be found. Oct 05 14:16:20.864078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:16:20.865681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] Returning 404 to user: Instance 986f4639-1911-4b57-b25a-06fe963fb97c could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:16:20.865681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d3b530ed-f29f-4b6f-9df9-9771891adce8 tempest-VolumesActionsTest-1082936294 tempest-VolumesActionsTest-1082936294-project] 10.222.0.16 "GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c" status: 404 len: 111 microversion: 2.1 time: 0.032398 Oct 05 14:16:20.865681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 333/643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:20 2022] GET /compute/v2.1/servers/986f4639-1911-4b57-b25a-06fe963fb97c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:16:21.193545 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:21.194439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:21.202696 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:21.203296 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:21.203813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:21.204883 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:21.205506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:21.206160 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:21.354410 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:21.363240 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:21.364952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:21.366407 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7eb813d3-734d-4360-839f-094986b64d4b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.176904 Oct 05 14:16:21.367467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 311/644] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:21 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:21.648915 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:21.649836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:21.655913 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:21.656401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:21.656843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:21.657749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:21.658206 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:21.658801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:21.869394 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:21.877141 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c50ebc62-9061-452b-bec2-5e47d9ab7155 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.233579 Oct 05 14:16:21.878235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 334/645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:21 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:22.392363 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:22.393559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:22.402122 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:22.402620 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:22.403042 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:22.404292 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:22.407522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:22.407906 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:22.493351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-f17e1154-ecd6-4435-a548-48a319cb87aa req-45fb295c-f9bb-4012-a0d9-70cf6030bda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7878cc3d-a93b-4551-97b3-61090ef3daef", "tag": "8b5ffccd-f60e-486a-aa4f-4db3b77208e9"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:22.531705 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-f17e1154-ecd6-4435-a548-48a319cb87aa req-45fb295c-f9bb-4012-a0d9-70cf6030bda9 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:22.532592 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-f17e1154-ecd6-4435-a548-48a319cb87aa req-45fb295c-f9bb-4012-a0d9-70cf6030bda9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:22.535481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-f17e1154-ecd6-4435-a548-48a319cb87aa req-45fb295c-f9bb-4012-a0d9-70cf6030bda9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:22.563507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-f17e1154-ecd6-4435-a548-48a319cb87aa req-45fb295c-f9bb-4012-a0d9-70cf6030bda9 service nova] Creating event network-changed:8b5ffccd-f60e-486a-aa4f-4db3b77208e9 for instance 7878cc3d-a93b-4551-97b3-61090ef3daef on hv-cinder-83587 Oct 05 14:16:22.577854 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-f17e1154-ecd6-4435-a548-48a319cb87aa req-45fb295c-f9bb-4012-a0d9-70cf6030bda9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087342 Oct 05 14:16:22.582889 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:22.584783 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 335/646] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:22.595195 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:22.597138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:22.598465 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bd9998d7-2049-4c2e-b276-7b8ce4271863 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.209849 Oct 05 14:16:22.611521 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 312/647] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:22 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:22.901491 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:22.902767 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:22.909923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:22.910857 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:22.911596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:22.913250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:22.914140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:22.920463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:23.083840 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:23.091772 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0db6bb08-5c96-4398-b2d3-a159a54d5bdf tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.195089 Oct 05 14:16:23.096649 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 336/648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:22 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:23.625623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:23.626230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:23.633355 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:23.633840 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:23.634273 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:23.634962 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:23.635412 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:23.635832 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:23.806150 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:23.815894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:23.819092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:23.820499 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-30b3b734-e41f-4d35-8eac-b635f8ddd94f tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.198739 Oct 05 14:16:23.821560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 313/649] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:23 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:24.115288 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:24.115857 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:24.122365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:24.123067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:24.123499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:24.124189 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:24.124645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:24.125058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:24.267638 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:24.276614 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c2ecf1e1-d00b-41ff-803d-9029208e0471 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.165898 Oct 05 14:16:24.277295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 337/650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:24 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:24.846784 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:24.847743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:24.855494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:24.855977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:24.856409 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:24.857105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:24.857587 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:24.858006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:24.991717 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:25.003172 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:25.005022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:25.006630 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-07c283e4-db2c-49a6-88dd-aa203ab7c39e tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.164180 Oct 05 14:16:25.007191 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 314/651] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:24 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:25.300999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:25.301507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:25.315183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:25.315673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:25.316177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:25.316934 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:25.317657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:25.318584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:25.481735 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:25.492301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-156efd46-cb90-4edc-bc3d-55d00f6870d8 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.195944 Oct 05 14:16:25.505304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 338/652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:25 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:26.155349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:26.156062 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:26.162711 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:26.163276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:26.163787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:26.164549 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:26.165078 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:26.165594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:26.302193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:26.311857 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:26.313590 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:26.314754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e1e96354-596d-4207-b7d8-64f2dfec71ca tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.286865 Oct 05 14:16:26.315646 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 315/653] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:26 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:26.517451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:26.518735 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:26.527302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:26.528144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:26.528884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:26.529812 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:26.530483 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:26.531171 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:26.750313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:26.764043 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-73eba4d1-cb4f-4d9b-a628-1b3e703bbd50 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.251050 Oct 05 14:16:26.777396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 339/654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:26 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:27.340487 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:27.341044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:27.347725 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:27.348211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:27.348661 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:27.349952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:27.350412 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:27.350841 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:27.490102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:27.498926 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:27.500469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:27.501768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0a44fc0b-03e8-4374-bed5-0ee5c78bf453 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.165298 Oct 05 14:16:27.502409 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 316/655] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:27 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:27.795843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:27.795843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:27.799626 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:27.800132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:27.800672 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:27.801499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:27.801996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:27.802423 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:27.999607 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:28.009519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-53288514-70b4-4f46-b8c8-60c1d57c89ea tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.222877 Oct 05 14:16:28.010095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 340/656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:27 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:28.527001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:28.527617 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:28.533975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:28.534454 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:28.535019 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:28.535567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:28.536017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:28.536977 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:28.678999 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:28.688063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:28.689930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:28.691105 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2ccf140b-a3aa-40d2-b308-f96afeb32820 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.168012 Oct 05 14:16:28.691663 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 317/657] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:28 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:29.032964 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:29.034459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:29.041993 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:29.042725 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:29.043330 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:29.044394 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:29.044864 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:29.045322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:29.209766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:29.218525 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fa082abc-be1b-43ad-8879-2375a9011296 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.189801 Oct 05 14:16:29.233540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 341/658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:29 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:29.716045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:29.716651 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:29.718631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:29.725063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:29.725574 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:29.726018 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:29.726722 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:29.727189 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:29.727612 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:29.879606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:29.888193 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:29.889691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:29.890862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d4341bba-4a0e-44fd-8616-64b21d18e694 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.178706 Oct 05 14:16:29.891417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 318/659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:29 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:30.243648 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:30.244265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:30.246239 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:30.246896 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=10 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:30.253112 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:30.253621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:30.254060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:30.254752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:30.255734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:30.256164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:30.388185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:30.395790 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-66debd96-ddd2-4c48-80ac-e1e65ce0847b tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.156030 Oct 05 14:16:30.396356 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 342/660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:30 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:30.916933 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:30.917575 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:30.923769 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:30.924260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:30.924700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:30.925427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:30.925886 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:30.926314 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:31.052853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:31.060957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:31.062433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:31.063595 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-317189f9-ea00-4988-b1e3-addbc157f890 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.150674 Oct 05 14:16:31.064148 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 319/661] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:30 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:31.418215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:31.418826 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:31.425051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:31.425575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:31.426014 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:31.426731 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:31.427191 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:31.427617 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:31.557143 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:31.564882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-faba2fed-f00e-45ba-bdb1-ceb50c540778 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.150442 Oct 05 14:16:31.565489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 343/662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:31 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:32.090359 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:32.091099 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:32.098222 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:32.099369 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:32.099802 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:32.100695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:32.101333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:32.101760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:32.305202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:32.319458 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:32.322199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:32.323905 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a1b71d7f-d2dc-4824-84e3-17b188235c72 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.238953 Oct 05 14:16:32.325152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 320/663] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:32 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:32.589843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:32.590461 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:32.596532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:32.597015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:32.597506 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:32.598195 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:32.599311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:32.599739 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:32.736899 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:32.740744 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:32.746983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-59dd062d-6661-44a1-8a37-293de6545126 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.160925 Oct 05 14:16:32.747562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 344/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:32 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:33.349743 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:33.350370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:33.357558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:33.358040 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:33.358472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:33.359156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:33.359604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:33.360023 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:33.492161 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:33.500512 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:33.502029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:33.503191 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8d46e7f4-5871-4271-9d5f-846e74c1e94b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.157313 Oct 05 14:16:33.503742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 321/665] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:33 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:33.769156 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:33.769839 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:33.777413 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:33.777897 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:33.778360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:33.779056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:33.779569 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:33.779947 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:33.907966 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:33.916067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c7396134-6981-4802-b742-6989fd52b5de tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.150881 Oct 05 14:16:33.916626 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 345/666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:33 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:34.528453 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:34.529101 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:34.535776 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:34.536545 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:34.536983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:34.537863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-d5e3f351-8932-4d4f-989c-3a973f50d90b req-de9a6a27-43a2-48cf-992a-cfd18173ce09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "name": "network-vif-plugged", "status": "completed", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:34.538026 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:34.538469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:34.538897 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:34.548006 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d5e3f351-8932-4d4f-989c-3a973f50d90b req-de9a6a27-43a2-48cf-992a-cfd18173ce09 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:34.548601 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d5e3f351-8932-4d4f-989c-3a973f50d90b req-de9a6a27-43a2-48cf-992a-cfd18173ce09 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:34.549187 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-d5e3f351-8932-4d4f-989c-3a973f50d90b req-de9a6a27-43a2-48cf-992a-cfd18173ce09 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:34.565077 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-d5e3f351-8932-4d4f-989c-3a973f50d90b req-de9a6a27-43a2-48cf-992a-cfd18173ce09 service nova] Creating event network-vif-plugged:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:16:34.570631 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-d5e3f351-8932-4d4f-989c-3a973f50d90b req-de9a6a27-43a2-48cf-992a-cfd18173ce09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 Oct 05 14:16:34.571396 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 346/667] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:34.682267 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:34.695024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:34.696616 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:34.698130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-71d4f56b-ce3b-43fa-9de5-72d64b45c46c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.173605 Oct 05 14:16:34.699214 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 322/668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:34 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:34.940349 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:34.941047 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:34.947766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:34.948242 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:34.948674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:34.949392 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:34.949845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:34.950266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:35.079665 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:35.087351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8ad4f1d3-d4fa-4c11-8e22-189a1618b268 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.151766 Oct 05 14:16:35.087908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 347/669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:34 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:35.726047 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:35.726657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:35.732955 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:35.733459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:35.733890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:35.734568 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:35.735014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:35.735434 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:35.755527 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:35.875093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:35.884898 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:35.886628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:35.887927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f95083ea-fdd4-4aa1-b72e-2b535288606c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1726 microversion: 2.20 time: 0.166478 Oct 05 14:16:35.888563 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 323/670] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:35 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:36.110231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:36.111406 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:36.119447 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:36.120336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:36.120580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:36.125081 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:36.125619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:36.126060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:36.296119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:36.306954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-34dacdfd-91f0-4293-95bb-a620fb166de0 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.200609 Oct 05 14:16:36.307678 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 348/671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:36 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:36.590699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-d96b212d-cd67-480c-b5d1-18c0b69e1d49 req-fc714ebe-2044-4f27-a328-f930cfdcfce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7878cc3d-a93b-4551-97b3-61090ef3daef", "name": "network-vif-plugged", "status": "completed", "tag": "8b5ffccd-f60e-486a-aa4f-4db3b77208e9"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:36.600794 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d96b212d-cd67-480c-b5d1-18c0b69e1d49 req-fc714ebe-2044-4f27-a328-f930cfdcfce2 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:36.601578 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d96b212d-cd67-480c-b5d1-18c0b69e1d49 req-fc714ebe-2044-4f27-a328-f930cfdcfce2 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:36.602242 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d96b212d-cd67-480c-b5d1-18c0b69e1d49 req-fc714ebe-2044-4f27-a328-f930cfdcfce2 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:36.614713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-d96b212d-cd67-480c-b5d1-18c0b69e1d49 req-fc714ebe-2044-4f27-a328-f930cfdcfce2 service nova] Creating event network-vif-plugged:8b5ffccd-f60e-486a-aa4f-4db3b77208e9 for instance 7878cc3d-a93b-4551-97b3-61090ef3daef on hv-cinder-83587 Oct 05 14:16:36.620622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-d96b212d-cd67-480c-b5d1-18c0b69e1d49 req-fc714ebe-2044-4f27-a328-f930cfdcfce2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033649 Oct 05 14:16:36.621381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 324/672] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:16:36.917705 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:36.918263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:36.924124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:36.924600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:36.925031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:36.925753 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:36.926188 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:36.927186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:37.080234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:37.089055 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:37.090520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:37.091692 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0e3994d9-a0d3-48f0-8c2a-058949147b1c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1713 microversion: 2.20 time: 0.177956 Oct 05 14:16:37.092243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 349/673] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:16:36 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1713 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:16:37.330365 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:37.331083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:37.337603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:37.338091 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:37.338524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:37.339209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:37.339664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:37.340088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:37.473844 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:37.481480 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d594f8c2-d905-49e3-b6af-8836d6caa7ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1366 microversion: 2.1 time: 0.155819 Oct 05 14:16:37.482045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 325/674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:37 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:38.504345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:38.505656 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:38.512174 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:38.512683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:38.513103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:38.513836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:38.514292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:38.514720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:38.649578 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:16:38.657600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5f1cfb0f-5fe4-4aff-a981-8f98eb45e2db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1556 microversion: 2.1 time: 0.157631 Oct 05 14:16:38.658169 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 350/675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:16:38 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:16:38.680420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:16:38.680990 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:16:38.687613 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:38.688098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:38.688536 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:38.689251 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:38.689748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:38.690207 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:38.770712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2e3e98e7-d5c0-4f13-9df2-6a7879ffd504 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094330 Oct 05 14:16:38.771540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 326/676] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:16:38 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:16:39.942564 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-453a2dab-ad18-4e72-a52c-f59ac6b602e6 req-8afd3436-bef5-4a66-a2f0-632f2d8372e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7878cc3d-a93b-4551-97b3-61090ef3daef", "tag": "8b5ffccd-f60e-486a-aa4f-4db3b77208e9"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:16:39.952236 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-453a2dab-ad18-4e72-a52c-f59ac6b602e6 req-8afd3436-bef5-4a66-a2f0-632f2d8372e6 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:16:39.952716 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-453a2dab-ad18-4e72-a52c-f59ac6b602e6 req-8afd3436-bef5-4a66-a2f0-632f2d8372e6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:16:39.953144 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-453a2dab-ad18-4e72-a52c-f59ac6b602e6 req-8afd3436-bef5-4a66-a2f0-632f2d8372e6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:16:39.963836 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-453a2dab-ad18-4e72-a52c-f59ac6b602e6 req-8afd3436-bef5-4a66-a2f0-632f2d8372e6 service nova] Creating event network-changed:8b5ffccd-f60e-486a-aa4f-4db3b77208e9 for instance 7878cc3d-a93b-4551-97b3-61090ef3daef on hv-cinder-83587 Oct 05 14:16:39.968678 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-453a2dab-ad18-4e72-a52c-f59ac6b602e6 req-8afd3436-bef5-4a66-a2f0-632f2d8372e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030447 Oct 05 14:16:39.969322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 351/677] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:10.136159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:10.136916 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=14 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:10.141618 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:10.144614 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:10.151600 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:10.152340 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:10.153603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:10.154317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:10.154927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:10.155499 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:10.210544 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3b3d0655-2909-4db3-9c00-5a27871183f6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076128 Oct 05 14:17:10.219077 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 327/678] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 14:17:10 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:10.325721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:10.326301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:10.337859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=46 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:10.338748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=34 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:10.340530 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:10.343854 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:10.344509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:10.347613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:10.348118 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:10.348717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:10.407629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:17:10.556223 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bb463940-84d7-424f-a65c-0ee9a7cdf929 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 204 len: 0 microversion: 2.20 time: 0.234180 Oct 05 14:17:10.557946 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 352/679] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 14:17:10 2022] DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 14:17:10.569445 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:10.570291 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:10.576820 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:10.577288 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:10.577789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:10.578419 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:10.578876 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:10.580008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:10.797456 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:10.808555 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:10.817066 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:10.820080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-835aa0c1-2825-49ff-934c-29ecba206b2b tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.257706 Oct 05 14:17:10.820673 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 328/680] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:17:10 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:17:11.849934 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:11.851180 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:11.851827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b8b9b570-febc-4999-ae72-b354ee11960b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Action: 'create', calling method: .version_select at 0x7f218d0d44c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-477654794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjLJgToBtl7WkNtybKUcJsAcrdA2pzdISuj8dYt/+Qf52KJgDndIfhrGNyJ1xAd6hE1nYIaGNnSCLsxCJX+SJNbzyC4jrkDWRBGPJFMDftCxJbG/vYcPnphKte5rLCl/g=="}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:11.867831 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-b8b9b570-febc-4999-ae72-b354ee11960b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Getting quotas for project 301ae8617218468c977da95e02cb75ee. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:17:11.871696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-b8b9b570-febc-4999-ae72-b354ee11960b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Getting quotas for user db1ece6236d04eddbb87c7e43f3f7e42 and project 301ae8617218468c977da95e02cb75ee. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:17:11.873050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:11.877335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:11.877799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:11.878874 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:11.879346 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:11.879839 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:11.895544 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b8b9b570-febc-4999-ae72-b354ee11960b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.223902 Oct 05 14:17:11.896155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 353/681] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:17:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:17:12.097851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:12.107778 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:12.109850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:12.111349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3079d360-1248-4f12-b519-5b8e8dde3bcd tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1719 microversion: 2.20 time: 0.265758 Oct 05 14:17:12.121815 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 329/682] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:17:11 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1719 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 14:17:13.139250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:13.140005 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:13.151108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:13.151519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:13.151963 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:13.152689 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:13.153152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:13.169758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:13.352747 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:13.368687 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:13.370561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e805d10dcc2e4dc7baf6792c7ca53510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791692a741cd49af91cce92a0672b57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:13.372520 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ae82ff90-60f2-4824-88f1-9809de6b61b9 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 200 len: 1652 microversion: 2.20 time: 0.237394 Oct 05 14:17:13.373618 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 354/683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:17:13 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 1652 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 14:17:13.475627 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-e1d8f881-c270-42fc-b155-e2f4df338084 req-1c9142b8-2772-4056-bded-0ebda5492032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aad4a0-81fb-4eb0-9a78-29e59b85923c", "name": "network-vif-deleted", "tag": "5905dce4-2589-4c0b-bac2-3832ebc08043"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:13.489000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e1d8f881-c270-42fc-b155-e2f4df338084 req-1c9142b8-2772-4056-bded-0ebda5492032 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:13.492014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e1d8f881-c270-42fc-b155-e2f4df338084 req-1c9142b8-2772-4056-bded-0ebda5492032 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:13.492582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e1d8f881-c270-42fc-b155-e2f4df338084 req-1c9142b8-2772-4056-bded-0ebda5492032 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:13.517936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-e1d8f881-c270-42fc-b155-e2f4df338084 req-1c9142b8-2772-4056-bded-0ebda5492032 service nova] Creating event network-vif-deleted:5905dce4-2589-4c0b-bac2-3832ebc08043 for instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c on hv-cinder-83587 Oct 05 14:17:13.524961 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-e1d8f881-c270-42fc-b155-e2f4df338084 req-1c9142b8-2772-4056-bded-0ebda5492032 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163318 Oct 05 14:17:13.526368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 330/684] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:17:14.400350 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:14.401037 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:14.407325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:14.407807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:14.408435 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:14.409562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:14.410474 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:14.411123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:14.426381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] HTTP exception thrown: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Request method failure captured: Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c HTTP/1.1 Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCM9vppXECOf60GL0HPRRcyYip9ruuJOE5DNkdnWvptw4BfWz2Z5CppFBXHRBeqkTy1kFt9Zr-5oeaXfHEYlwExwASFP0-aNOyGC9-Wwbewn5Y8kabu5NaNfEZSWW_Ct3mSUozvet1x8LLQy3FRSbadkJ9Xt2KCGus6d_xLqxNyFuY Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:17:14.428635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791692a741cd49af91cce92a0672b57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791692a741cd49af91cce92a0672b57a"}]}] Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: e805d10dcc2e4dc7baf6792c7ca53510 Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:14.430264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '91aad4a0-81fb-4eb0-9a78-29e59b85923c'} Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:14.431194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:14.432868 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:14.435248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Returning 404 to user: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:14.435248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-01fc08b5-4d75-4b8b-be42-7a891cb6f5fe tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 404 len: 111 microversion: 2.20 time: 0.038377 Oct 05 14:17:14.435248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 355/685] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:17:14 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:17:14.450395 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a930fed6-d925-4c3c-a91e-eacf95554b89 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '.version_select at 0x7f218d1c9280>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:14.469712 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a930fed6-d925-4c3c-a91e-eacf95554b89 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205916231" status: 204 len: 0 microversion: 2.20 time: 0.027448 Oct 05 14:17:14.473447 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 331/686] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 5 14:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205916231 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 14:17:15.850226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:15.850809 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:15.857145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:15.857659 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:15.858095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:15.858780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:15.859230 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:15.859675 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:15.885252 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ac1701f3-df62-4098-abde-f09ed66e814f tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/ips" status: 200 len: 150 microversion: 2.1 time: 0.039648 Oct 05 14:17:15.885981 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 356/687] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:17:15 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:16.280246 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:16.280871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:16.288342 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:16.288953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:16.289736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:16.290691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:16.291453 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:16.292066 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:16.307575 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] HTTP exception thrown: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Request method failure captured: Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c HTTP/1.1 Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCM9vppXECOf60GL0HPRRcyYip9ruuJOE5DNkdnWvptw4BfWz2Z5CppFBXHRBeqkTy1kFt9Zr-5oeaXfHEYlwExwASFP0-aNOyGC9-Wwbewn5Y8kabu5NaNfEZSWW_Ct3mSUozvet1x8LLQy3FRSbadkJ9Xt2KCGus6d_xLqxNyFuY Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:16.309639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791692a741cd49af91cce92a0672b57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791692a741cd49af91cce92a0672b57a"}]}] Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: e805d10dcc2e4dc7baf6792c7ca53510 Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.311286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '91aad4a0-81fb-4eb0-9a78-29e59b85923c'} Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:16.312129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.313387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.314867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Returning 404 to user: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:16.314867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f1e42caf-789a-4a60-b29b-88978a624ee6 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 404 len: 111 microversion: 2.20 time: 0.035195 Oct 05 14:17:16.314867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 332/688] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 14:17:16 2022] DELETE /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:17:16.319820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:16.320509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 91aad4a0-81fb-4eb0-9a78-29e59b85923c] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:16.326683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:16.327280 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:16.328117 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:16.329185 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:16.329924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:16.330419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:16.344933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] HTTP exception thrown: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Request method failure captured: Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c HTTP/1.1 Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCM9vppXECOf60GL0HPRRcyYip9ruuJOE5DNkdnWvptw4BfWz2Z5CppFBXHRBeqkTy1kFt9Zr-5oeaXfHEYlwExwASFP0-aNOyGC9-Wwbewn5Y8kabu5NaNfEZSWW_Ct3mSUozvet1x8LLQy3FRSbadkJ9Xt2KCGus6d_xLqxNyFuY Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:17:16.346543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791692a741cd49af91cce92a0672b57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791692a741cd49af91cce92a0672b57a"}]}] Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: e805d10dcc2e4dc7baf6792c7ca53510 Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.348232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '91aad4a0-81fb-4eb0-9a78-29e59b85923c'} Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:16.349203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. Oct 05 14:17:16.351378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:16.352749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Returning 404 to user: Instance 91aad4a0-81fb-4eb0-9a78-29e59b85923c could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:16.352749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e81988b1-8df3-46c0-971e-1bd579c5618a tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c" status: 404 len: 111 microversion: 2.20 time: 0.032033 Oct 05 14:17:16.352749 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 357/689] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:17:16 2022] GET /compute/v2.1/servers/91aad4a0-81fb-4eb0-9a78-29e59b85923c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:17:17.257691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26f02f9e-2915-432f-a35f-42ebe1a04be9"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:17.260036 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:17.265947 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:17.266433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:17.266873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:17.267564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:17.268024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:17.268457 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:17.514146 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:17.514724 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:17.522493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:17.522972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:17.523443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:17.524274 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:17.524763 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:17.525338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:17.528692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8db5f9d6-cb01-438c-a893-7796b1f2b6ef tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "POST /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274849 Oct 05 14:17:17.529349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 333/690] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:17:17 2022] POST /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:17.553916 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] HTTP exception thrown: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Request method failure captured: Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 HTTP/1.1 Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZCM9vppXECOf60GL0HPRRcyYip9ruuJOE5DNkdnWvptw4BfWz2Z5CppFBXHRBeqkTy1kFt9Zr-5oeaXfHEYlwExwASFP0-aNOyGC9-Wwbewn5Y8kabu5NaNfEZSWW_Ct3mSUozvet1x8LLQy3FRSbadkJ9Xt2KCGus6d_xLqxNyFuY Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:17:17.555797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791692a741cd49af91cce92a0672b57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791692a741cd49af91cce92a0672b57a"}]}] Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: e805d10dcc2e4dc7baf6792c7ca53510 Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.557218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '8a20e784-a0e0-498b-b35e-698c29824ce3'} Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:17.558292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.559596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.560802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Returning 404 to user: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:17.560802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2c6302ec-86c0-4a12-9db6-7c0332c1a9a5 tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 404 len: 111 microversion: 2.20 time: 0.049130 Oct 05 14:17:17.560802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 358/691] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 14:17:17 2022] DELETE /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 05 14:17:17.573837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:17.574560 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] [instance: 8a20e784-a0e0-498b-b35e-698c29824ce3] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:17.583756 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:17.584754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:17.585109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:17.585853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:17.586335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:17.586769 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:17.609541 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] HTTP exception thrown: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Request method failure captured: Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 HTTP/1.1 Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZCM9vppXECOf60GL0HPRRcyYip9ruuJOE5DNkdnWvptw4BfWz2Z5CppFBXHRBeqkTy1kFt9Zr-5oeaXfHEYlwExwASFP0-aNOyGC9-Wwbewn5Y8kabu5NaNfEZSWW_Ct3mSUozvet1x8LLQy3FRSbadkJ9Xt2KCGus6d_xLqxNyFuY Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:17.611223 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/791692a741cd49af91cce92a0672b57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/791692a741cd49af91cce92a0672b57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_791692a741cd49af91cce92a0672b57a"}]}] Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 791692a741cd49af91cce92a0672b57a Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919536959 Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: e805d10dcc2e4dc7baf6792c7ca53510 Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919536959-project Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.612594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '8a20e784-a0e0-498b-b35e-698c29824ce3'} Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:17.613634 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. Oct 05 14:17:17.614819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:17.615949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] Returning 404 to user: Instance 8a20e784-a0e0-498b-b35e-698c29824ce3 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:17.615949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-614e82ef-08b4-470c-985c-34fd43fdea8c tempest-AttachVolumeShelveTestJSON-1919536959 tempest-AttachVolumeShelveTestJSON-1919536959-project] 10.222.0.16 "GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3" status: 404 len: 111 microversion: 2.20 time: 0.049997 Oct 05 14:17:17.615949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 334/692] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 14:17:17 2022] GET /compute/v2.1/servers/8a20e784-a0e0-498b-b35e-698c29824ce3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 14:17:18.885074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:18.886428 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:18.894612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:18.895053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:18.895488 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:18.896225 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:18.897384 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:18.897817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:19.001958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lazy-loading 'services' on Instance uuid 7878cc3d-a93b-4551-97b3-61090ef3daef {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:17:19.093940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-89c9e236-f9d1-4db6-b57f-f6a4cab96d1a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments/26f02f9e-2915-432f-a35f-42ebe1a04be9" status: 202 len: 0 microversion: 2.1 time: 0.216343 Oct 05 14:17:19.094973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 359/693] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:17:18 2022] DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments/26f02f9e-2915-432f-a35f-42ebe1a04be9 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:17:19.104102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:19.106492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:19.114210 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:19.115854 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:19.116423 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:19.118822 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:19.119293 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:19.119727 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:19.152923 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-42b518b4-b23d-4ac4-8434-e8b7a145dd28 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052876 Oct 05 14:17:19.153947 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 335/694] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:17:19 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:20.167148 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:20.171156 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:20.179210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:20.179700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:20.180134 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:20.180823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:20.181302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:20.181721 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:20.214000 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7316517b-1166-4171-bdc0-10ed9af2b06a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051573 Oct 05 14:17:20.214482 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 360/695] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:17:20 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:17:20.281098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:20.281672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:20.289147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:20.289760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:20.290261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:20.290971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:20.291432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:20.291851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:20.318270 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:17:20.399253 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-024382b1-3ed1-4c2a-8157-1e91c69a65d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 204 len: 0 microversion: 2.1 time: 0.121619 Oct 05 14:17:20.400030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 336/696] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:17:20 2022] DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:17:20.408430 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:20.409183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:20.418213 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:20.419024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:20.419674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:20.420576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:20.421282 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:20.421938 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:20.601154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:20.609024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-726d4eee-6a19-43a2-86ac-da1d44d10862 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1681 microversion: 2.1 time: 0.204802 Oct 05 14:17:20.609628 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 361/697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:20 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:21.634117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:21.635403 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:21.642553 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:21.643058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:21.643495 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:21.644221 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:21.644669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:21.645087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:21.809493 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:21.817771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b7ce34b4-759c-4c42-a2b5-0286bc39fb8d tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1681 microversion: 2.1 time: 0.188552 Oct 05 14:17:21.818368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 337/698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:21 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:22.841789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:22.843167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:22.851197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=4 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:22.854451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:22.855160 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:22.855820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:22.856710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:22.857284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:22.857640 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:22.949243 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fca6a15a17c423393582da43abec450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3297ab419b04e7faf1738e64ab28c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:22.962116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0f2ccbc0-c55f-4e02-9fef-87681450d361 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 200 len: 1614 microversion: 2.1 time: 0.124124 Oct 05 14:17:22.962739 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 362/699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:22 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 1614 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:23.097171 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-2662548b-3bdc-4daa-8879-5fcfdfc41267 req-ec854c3e-b13f-4d87-87ef-9d4064d14c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7878cc3d-a93b-4551-97b3-61090ef3daef", "name": "network-vif-deleted", "tag": "8b5ffccd-f60e-486a-aa4f-4db3b77208e9"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:23.119619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-2662548b-3bdc-4daa-8879-5fcfdfc41267 req-ec854c3e-b13f-4d87-87ef-9d4064d14c42 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:23.120719 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-2662548b-3bdc-4daa-8879-5fcfdfc41267 req-ec854c3e-b13f-4d87-87ef-9d4064d14c42 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:23.121413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-2662548b-3bdc-4daa-8879-5fcfdfc41267 req-ec854c3e-b13f-4d87-87ef-9d4064d14c42 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:23.135840 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-2662548b-3bdc-4daa-8879-5fcfdfc41267 req-ec854c3e-b13f-4d87-87ef-9d4064d14c42 service nova] Creating event network-vif-deleted:8b5ffccd-f60e-486a-aa4f-4db3b77208e9 for instance 7878cc3d-a93b-4551-97b3-61090ef3daef on hv-cinder-83587 Oct 05 14:17:23.146939 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-2662548b-3bdc-4daa-8879-5fcfdfc41267 req-ec854c3e-b13f-4d87-87ef-9d4064d14c42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063128 Oct 05 14:17:23.147714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 338/700] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:23.986980 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:23.988917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:23.997063 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:23.997992 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:23.998820 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:23.999740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:24.000398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:24.001053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:24.018174 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef HTTP/1.1 Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:17:24.020250 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:24.022351 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '7878cc3d-a93b-4551-97b3-61090ef3daef'} Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:24.023138 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:24.024372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:24.026145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:24.026145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-69d305ea-e7cf-4659-a884-6c48de42b590 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 404 len: 111 microversion: 2.1 time: 0.040028 Oct 05 14:17:24.027148 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 363/701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:23 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:24.032787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2aefe927-2087-407d-b3a8-c9083548314a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '.version_select at 0x7f218d1c9ee0>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:24.059338 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2aefe927-2087-407d-b3a8-c9083548314a tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097402380" status: 202 len: 0 microversion: 2.1 time: 0.030626 Oct 05 14:17:24.059929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 339/702] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 14:17:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097402380 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:17:26.061513 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:26.062563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:26.069827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:26.070495 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:26.071189 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:26.072070 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:26.072522 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:26.072941 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:26.087816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef HTTP/1.1 Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:17:26.089686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.091192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '7878cc3d-a93b-4551-97b3-61090ef3daef'} Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:26.092069 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.093516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.095828 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:26.096874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-467348da-e62b-4940-a4ae-abd4b0f6aed9 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 404 len: 111 microversion: 2.1 time: 0.040914 Oct 05 14:17:26.097699 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 364/703] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:17:26 2022] DELETE /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:26.106571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:26.108030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 7878cc3d-a93b-4551-97b3-61090ef3daef] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:26.120136 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:26.120666 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:26.121127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:26.121838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:26.122273 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:26.122745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:26.153714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef HTTP/1.1 Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:26.172032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.174571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '7878cc3d-a93b-4551-97b3-61090ef3daef'} Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:26.175804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. Oct 05 14:17:26.177693 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:26.179888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 7878cc3d-a93b-4551-97b3-61090ef3daef could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:26.179888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3ed388e5-e4bb-4e1b-9a3e-5ce25a33e528 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef" status: 404 len: 111 microversion: 2.1 time: 0.071211 Oct 05 14:17:26.179888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 340/704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:26 2022] GET /compute/v2.1/servers/7878cc3d-a93b-4551-97b3-61090ef3daef => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:26.571125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-510371322", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-477654794", "security_groups": [{"name": "tempest-secgroup-smoke-455774830"}], "networks": [{"uuid": "eacdcf30-621a-417c-9fce-8a204bacb962"}], "block_device_mapping_v2": [{"uuid": "ba7bbfcd-dff1-45e0-aea4-5aedbb5b3934", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:26.749954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] validate_networks() for [('eacdcf30-621a-417c-9fce-8a204bacb962', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:17:27.571462 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-db8d6aea-d1a3-4c7f-a711-5790db766d35 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: .version_select at 0x7f218d0cd8b0>, body: {"keypair": {"name": "tempest-keypair-998890400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLQCy66el6w4FbJmGxmAWr8D1ecVDjh/GmVs2tiqjKNlX+MjSOnr8r1d3TubxX2tXU6EytzSAqf72tHJkwbyy7UXcz1sAhA/hr78vLkR7Kq6LS3COYjq2W53RUm7xfOIQ=="}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:27.582817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:17:27.583307 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:17:27.584338 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:17:27.584751 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:17:27.585169 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:17:27.587405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-db8d6aea-d1a3-4c7f-a711-5790db766d35 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:17:27.592066 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-db8d6aea-d1a3-4c7f-a711-5790db766d35 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for user d0245460724a442292f738e7e947c87b and project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:17:27.594479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.595033 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.595538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.596361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.596908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.597427 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.614722 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-db8d6aea-d1a3-4c7f-a711-5790db766d35 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186692 Oct 05 14:17:27.615330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 341/705] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:17:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:27.615443 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Getting quotas for project 301ae8617218468c977da95e02cb75ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:17:27.619946 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:27.620433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:27.628893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Getting quotas for user db1ece6236d04eddbb87c7e43f3f7e42 and project 301ae8617218468c977da95e02cb75ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:17:27.634346 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.634988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.635737 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.636628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.637685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.637917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.658513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a HTTP/1.1 Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:27.660173 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.661689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'e9a8c159-6cf1-4a0e-87cb-a0035fe3730a'} Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:27.662496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.664083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.665655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:27.665655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6d0b7734-75fd-4ed9-8d05-62cc0edfb960 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 404 len: 111 microversion: 2.1 time: 0.045822 Oct 05 14:17:27.665655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 342/706] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:17:27 2022] DELETE /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:27.671576 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:27.672206 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: e9a8c159-6cf1-4a0e-87cb-a0035fe3730a] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:27.679056 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.679559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.680050 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.680821 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.681499 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.681952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.698333 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a HTTP/1.1 Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:27.699894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.701278 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': 'e9a8c159-6cf1-4a0e-87cb-a0035fe3730a'} Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:27.702008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. Oct 05 14:17:27.703459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.705185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance e9a8c159-6cf1-4a0e-87cb-a0035fe3730a could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:27.705185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a725a718-2b09-4208-896e-fb66062b120e tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a" status: 404 len: 111 microversion: 2.1 time: 0.033867 Oct 05 14:17:27.705185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 343/707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:27 2022] GET /compute/v2.1/servers/e9a8c159-6cf1-4a0e-87cb-a0035fe3730a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 14:17:27.710709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:27.711211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:27.717882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.718378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.718820 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.719857 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.720325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.720757 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.732944 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:17:27.735146 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba7bbfcd-dff1-45e0-aea4-5aedbb5b3934',volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:17:27.758243 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 HTTP/1.1 Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:27.760268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.761902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '245338e3-b9ea-4ad8-909a-79f8f3e917c0'} Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:27.762689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.765632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.768374 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:27.768374 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6b337f73-713d-4248-8619-d682d9d155db tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 404 len: 111 microversion: 2.1 time: 0.055521 Oct 05 14:17:27.768374 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 344/708] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:17:27 2022] DELETE /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:27.775508 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:27.776372 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 245338e3-b9ea-4ad8-909a-79f8f3e917c0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:27.791437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.792958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.794624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.795661 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:27.796116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:27.796607 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:27.825416 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 HTTP/1.1 Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:27.827584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.829362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '245338e3-b9ea-4ad8-909a-79f8f3e917c0'} Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:27.830269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. Oct 05 14:17:27.831952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:27.835265 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 245338e3-b9ea-4ad8-909a-79f8f3e917c0 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:27.836151 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f09725bc-f878-4c4e-b0fa-c51da0421080 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0" status: 404 len: 111 microversion: 2.1 time: 0.068858 Oct 05 14:17:27.836720 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 345/709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:27 2022] GET /compute/v2.1/servers/245338e3-b9ea-4ad8-909a-79f8f3e917c0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:27.983895 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-28a80667-b0a6-4e8a-9827-13f29225faf2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.417039 Oct 05 14:17:27.997983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9c6b5c0e-cc0e-4248-a46c-e81ed824d713 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:27.999188 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9c6b5c0e-cc0e-4248-a46c-e81ed824d713 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:28.008908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 365/710] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:17:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:17:28.100381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-9c6b5c0e-cc0e-4248-a46c-e81ed824d713 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:28.108405 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9c6b5c0e-cc0e-4248-a46c-e81ed824d713 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1087 microversion: 2.1 time: 0.114333 Oct 05 14:17:28.125032 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 346/711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:27 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1087 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:29.036688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:29.037291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:29.047263 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:29.048344 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:29.048882 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:29.049729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:29.050257 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:29.050686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:29.067158 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 HTTP/1.1 Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:17:29.069519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.070883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '6a118798-a10a-4c6e-a661-74572c33dc01'} Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:29.071654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.073893 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.076162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:29.076162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-969ba33a-6049-4a84-98d6-234563862a08 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 404 len: 111 microversion: 2.1 time: 0.041368 Oct 05 14:17:29.076162 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 366/712] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:17:29 2022] DELETE /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:29.080069 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:29.081026 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] [instance: 6a118798-a10a-4c6e-a661-74572c33dc01] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:29.087868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:29.088473 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:29.088980 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:29.090007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:29.090523 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:29.091588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:29.105545 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] HTTP exception thrown: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Request method failure captured: Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 HTTP/1.1 Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZDKhc1OUeBLVjAVj-KbtvcrYO9nvj2J4T_9CBFwCNPEeExHmd8XkUdTjLlVs8yUQDhGdRgHEaH4IUjAYbygwM73IKPh9IQ79kEhkAxpGuc66q11scOXu68I4dcVILjRxw1HOra0WuBBL2CpnZYNxUImy-h0xrfCGpeyIX70kRftBuw Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:17:29.107370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3297ab419b04e7faf1738e64ab28c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3297ab419b04e7faf1738e64ab28c3c"}]}] Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b3297ab419b04e7faf1738e64ab28c3c Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554856508 Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 5fca6a15a17c423393582da43abec450 Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeNegativeTest-1554856508-project Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.109082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '6a118798-a10a-4c6e-a661-74572c33dc01'} Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:17:29.110140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. Oct 05 14:17:29.111572 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:17:29.112829 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] Returning 404 to user: Instance 6a118798-a10a-4c6e-a661-74572c33dc01 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:17:29.112829 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-249d74d6-31a8-401c-813a-f0cd880395d1 tempest-AttachVolumeNegativeTest-1554856508 tempest-AttachVolumeNegativeTest-1554856508-project] 10.222.0.16 "GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01" status: 404 len: 111 microversion: 2.1 time: 0.032924 Oct 05 14:17:29.112829 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 347/713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:29 2022] GET /compute/v2.1/servers/6a118798-a10a-4c6e-a661-74572c33dc01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:17:29.140103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:29.140758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:29.147914 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:29.148477 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:29.148943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:29.149841 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:29.150363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:29.151054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:29.192058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1011921033", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9efe8cc8-cefb-4fdc-a174-ba54f8a177b3"}], "security_groups": [{"name": "tempest-securitygroup--537342755"}], "key_name": "tempest-keypair-998890400", "user_data": "}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:29.277092 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:29.290796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6a77748c-64fc-4a1b-943e-13f49bf8e86e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1185 microversion: 2.1 time: 0.154691 Oct 05 14:17:29.297360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 367/714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:29 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:29.348243 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] validate_networks() for [('9efe8cc8-cefb-4fdc-a174-ba54f8a177b3', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:17:30.260836 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:17:30.261439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:17:30.261857 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:17:30.262367 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:17:30.262993 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:17:30.272659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:30.273265 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:30.273758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:30.274566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:30.275023 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:30.275447 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:30.298242 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:17:30.303557 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for user d0245460724a442292f738e7e947c87b and project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:17:30.317018 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:30.317685 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:30.328267 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:30.328759 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:30.329197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:30.331861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:17:30.334262 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:17:30.340088 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:30.340088 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:30.340477 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:30.396829 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9d41a1a1-9493-4fd5-967f-bcaf72998c84 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.208911 Oct 05 14:17:30.397514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 348/715] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:17:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:17:30.409143 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-531d783b-8ee8-4fb5-8cdf-578bb110b0a1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:30.410044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-531d783b-8ee8-4fb5-8cdf-578bb110b0a1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:30.463728 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:30.474377 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-89f1dc71-d516-4fc6-9e4d-8aad5ace5d41 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1191 microversion: 2.1 time: 0.160211 Oct 05 14:17:30.475106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 368/716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:30 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1191 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:17:30.482700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-531d783b-8ee8-4fb5-8cdf-578bb110b0a1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:30.493954 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-531d783b-8ee8-4fb5-8cdf-578bb110b0a1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1237 microversion: 2.1 time: 0.089226 Oct 05 14:17:30.494552 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 349/717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:30 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:31.498825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:31.499451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:31.505757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:31.506246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:31.506688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:31.507383 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:31.507842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:31.508306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:31.518064 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:31.518682 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:31.525486 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:31.526218 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:31.526674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:31.527582 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:31.528205 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:31.528813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:31.600645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:31.609090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-e7ef13e8-87ab-41f8-958f-289860b28543 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1289 microversion: 2.1 time: 0.095455 Oct 05 14:17:31.616893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 350/718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:31 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:31.930606 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:31.939237 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7d79d7f2-a6e2-4fa0-a667-7858da7e43ef tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.444181 Oct 05 14:17:31.940363 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 369/719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:31 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:32.636189 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:32.637090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:32.645306 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:32.647031 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:32.647831 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:32.648860 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:32.649770 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:32.650624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:32.758711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-fccd73d1-c5d7-4b53-ae78-b8e8d65c268e req-90fb32e3-13b4-4022-8f5a-bc7dfca296f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:32.778024 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-fccd73d1-c5d7-4b53-ae78-b8e8d65c268e req-90fb32e3-13b4-4022-8f5a-bc7dfca296f5 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:32.778741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-fccd73d1-c5d7-4b53-ae78-b8e8d65c268e req-90fb32e3-13b4-4022-8f5a-bc7dfca296f5 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:32.780463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-fccd73d1-c5d7-4b53-ae78-b8e8d65c268e req-90fb32e3-13b4-4022-8f5a-bc7dfca296f5 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:32.804218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-fccd73d1-c5d7-4b53-ae78-b8e8d65c268e req-90fb32e3-13b4-4022-8f5a-bc7dfca296f5 service nova] Creating event network-changed:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:17:32.810851 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-fccd73d1-c5d7-4b53-ae78-b8e8d65c268e req-90fb32e3-13b4-4022-8f5a-bc7dfca296f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055685 Oct 05 14:17:32.811924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 370/720] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:17:32.968438 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:32.969580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:32.979177 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:32.980001 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:32.980683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:32.982532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:32.983741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:32.984518 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:33.031343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:33.039020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-91f2f172-6861-4b22-a7c8-65a60e9d9843 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.409650 Oct 05 14:17:33.042017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 351/721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:32 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:33.301067 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:33.316919 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bcd325da-cdbc-4018-838f-ddb34b72e29d tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.357599 Oct 05 14:17:33.329219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 371/722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:32 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:17:33.485685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-f4af8b10-cb8e-4bcb-b6fd-9ad3f38c450e req-7bb62565-3596-44e9-afab-9c1f2c0ec8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412dd90-2b82-4914-a28f-cc8af68472e6", "tag": "3c004758-1b5c-43fc-8097-9b75e38b9e20"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:33.498972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f4af8b10-cb8e-4bcb-b6fd-9ad3f38c450e req-7bb62565-3596-44e9-afab-9c1f2c0ec8e2 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:33.499548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f4af8b10-cb8e-4bcb-b6fd-9ad3f38c450e req-7bb62565-3596-44e9-afab-9c1f2c0ec8e2 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:33.499975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f4af8b10-cb8e-4bcb-b6fd-9ad3f38c450e req-7bb62565-3596-44e9-afab-9c1f2c0ec8e2 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:33.514987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-f4af8b10-cb8e-4bcb-b6fd-9ad3f38c450e req-7bb62565-3596-44e9-afab-9c1f2c0ec8e2 service nova] Creating event network-changed:3c004758-1b5c-43fc-8097-9b75e38b9e20 for instance 0412dd90-2b82-4914-a28f-cc8af68472e6 on hv-cinder-83587 Oct 05 14:17:33.521692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-f4af8b10-cb8e-4bcb-b6fd-9ad3f38c450e req-7bb62565-3596-44e9-afab-9c1f2c0ec8e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114430 Oct 05 14:17:33.523008 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 352/723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:17:34.065163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:34.065825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:34.072663 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:34.073485 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:34.074179 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:34.075128 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:34.075656 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:34.076150 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:34.293682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:34.297748 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:34.304958 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-25e145e7-153e-4fb7-a9a9-bcc96f2e571f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.243643 Oct 05 14:17:34.305568 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 372/724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:34 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:34.352052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:34.352764 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:34.359625 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:34.360360 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:34.360793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:34.361510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:34.361962 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:34.362539 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:34.383175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:34.596855 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:34.609783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0a93d489-9443-464c-a3b5-aab8caa1a125 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.261739 Oct 05 14:17:34.628494 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 353/725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:34 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:35.328512 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:35.329246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:35.337738 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:35.338306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:35.338744 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:35.339517 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:35.339996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:35.340620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:35.577244 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:35.589534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-13428f1c-4b5e-4936-8050-82a1c31ca0c3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.265239 Oct 05 14:17:35.607965 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 373/726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:35 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:35.638489 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:35.640004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:35.652448 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:35.653108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:35.653851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:35.655510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:35.656072 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:35.656606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:35.894471 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:35.902594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-92b417bf-e864-4936-9830-fd530d3c8ee0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.270500 Oct 05 14:17:35.903102 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 354/727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:35 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:36.612710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:36.614118 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:36.621182 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:36.621812 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:36.622354 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:36.623164 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:36.624084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:36.624622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:36.786637 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:36.797782 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-70e66a00-5e05-4c89-98b0-b23d850f801e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.188855 Oct 05 14:17:36.809287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 374/728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:36 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:36.925209 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:36.926461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:36.932747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:36.933396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:36.934049 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:36.935642 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:36.936108 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:36.936713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:37.087092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:37.095099 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-64d9f6b4-ec7c-42db-a382-8e8b53665587 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.173839 Oct 05 14:17:37.095830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 355/729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:36 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:37.822348 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:37.822872 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:37.824699 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:37.825871 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=6 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:37.831308 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:37.831789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:37.832223 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:37.832913 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:37.833403 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:37.836519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:37.962614 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:37.970096 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-38a6a15e-f74f-4b43-a7d0-8afa2a0294d2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.152382 Oct 05 14:17:37.970657 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 375/730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:37 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:38.118471 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:38.119009 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:38.122417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:38.126229 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:38.126717 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:38.127157 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:38.127845 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:38.128303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:38.128730 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:38.272349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:38.279908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4848e7ed-6cfb-4b18-a925-d80b53713f09 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.165871 Oct 05 14:17:38.280466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 356/731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:38 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:38.850549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-0145af08-016f-4bcf-902d-336805bcdffe req-718b427d-408a-44c2-a722-c2a243960ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "name": "network-vif-plugged", "status": "completed", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:38.861774 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-0145af08-016f-4bcf-902d-336805bcdffe req-718b427d-408a-44c2-a722-c2a243960ae9 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:38.862256 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-0145af08-016f-4bcf-902d-336805bcdffe req-718b427d-408a-44c2-a722-c2a243960ae9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:38.862676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-0145af08-016f-4bcf-902d-336805bcdffe req-718b427d-408a-44c2-a722-c2a243960ae9 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:38.874979 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-0145af08-016f-4bcf-902d-336805bcdffe req-718b427d-408a-44c2-a722-c2a243960ae9 service nova] Creating event network-vif-plugged:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:17:38.887418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-0145af08-016f-4bcf-902d-336805bcdffe req-718b427d-408a-44c2-a722-c2a243960ae9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170923 Oct 05 14:17:38.888249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 376/732] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:38.992182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:38.993055 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:38.999165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:38.999684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:39.000125 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:39.000835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:39.001315 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:39.001745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:39.200742 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:39.209413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4396ebcd-f2d1-417c-b0ce-b9543c34f312 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.221359 Oct 05 14:17:39.209987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 357/733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:38 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:39.303802 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:39.304505 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:39.310619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:39.311100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:39.311540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:39.312227 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:39.312692 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:39.313118 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:39.446056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:39.453585 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-de0202a6-ceeb-4ef0-ac79-cd404d18c782 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.154437 Oct 05 14:17:39.454148 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 377/734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:39 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:40.233154 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:40.233800 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:40.241003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:40.241882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:40.242328 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:40.243039 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:40.243475 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:40.243897 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:40.288787 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:40.369340 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:40.376778 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8473033f-1219-4606-b53e-cdc6a0b2d076 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.147443 Oct 05 14:17:40.377352 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 358/735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:40 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:40.478512 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:40.479140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:40.481979 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:40.489051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:40.490454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:40.491151 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:40.491955 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:40.492535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:40.493353 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:40.638495 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:40.646154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3e3397ff-5de5-4c89-83f3-179fbb1d8944 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1258 microversion: 2.1 time: 0.173598 Oct 05 14:17:40.646712 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 378/736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:40 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:40.903888 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-c492ad8e-9e1a-4df3-9986-2c84d8b80413 req-c2f8543c-e812-49f8-982d-86911b906545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412dd90-2b82-4914-a28f-cc8af68472e6", "name": "network-vif-plugged", "status": "completed", "tag": "3c004758-1b5c-43fc-8097-9b75e38b9e20"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:40.908700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=14 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:40.915260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c492ad8e-9e1a-4df3-9986-2c84d8b80413 req-c2f8543c-e812-49f8-982d-86911b906545 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:40.915848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c492ad8e-9e1a-4df3-9986-2c84d8b80413 req-c2f8543c-e812-49f8-982d-86911b906545 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:40.916302 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-c492ad8e-9e1a-4df3-9986-2c84d8b80413 req-c2f8543c-e812-49f8-982d-86911b906545 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:40.927347 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-c492ad8e-9e1a-4df3-9986-2c84d8b80413 req-c2f8543c-e812-49f8-982d-86911b906545 service nova] Creating event network-vif-plugged:3c004758-1b5c-43fc-8097-9b75e38b9e20 for instance 0412dd90-2b82-4914-a28f-cc8af68472e6 on hv-cinder-83587 Oct 05 14:17:40.932056 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-c492ad8e-9e1a-4df3-9986-2c84d8b80413 req-c2f8543c-e812-49f8-982d-86911b906545 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031826 Oct 05 14:17:40.932623 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 359/737] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:41.400100 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:41.400823 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:41.406855 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:41.407345 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:41.408195 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:41.409116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:41.409605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:41.410217 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:41.546715 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:41.554811 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fa84ec5b-c279-4b5d-be6b-4e2dd62397a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1362 microversion: 2.1 time: 0.159110 Oct 05 14:17:41.555378 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 379/738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:41 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:41.668799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:41.669552 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:41.675597 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:41.676080 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:41.676523 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:41.677771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:41.678232 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:41.678667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:41.812650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:41.821061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-55d14bd6-1b87-4363-ac1b-cb3f8c226bc2 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1441 microversion: 2.1 time: 0.156901 Oct 05 14:17:41.821979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 360/739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:41 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1441 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:41.843451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:41.844058 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:41.851207 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:41.851686 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:41.852120 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:41.852805 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:41.853282 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:41.853704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:41.980097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:41.987883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dfb5f417-fbcf-43a8-884b-8aa0bf4e0fd5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1441 microversion: 2.1 time: 0.148274 Oct 05 14:17:41.988707 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 380/740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:41 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1441 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:42.578180 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:42.578945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:42.585292 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:42.585791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:42.586232 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:42.587376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:42.587376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:42.587788 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:42.845362 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:17:42.853887 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bac62868-bc35-49ff-bff4-02228d3b978d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1549 microversion: 2.1 time: 0.279917 Oct 05 14:17:42.865317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 361/741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:17:42 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1549 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:17:42.878770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:17:42.879265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:17:42.885902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:42.886389 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:42.886827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:42.887526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:42.887982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:42.888410 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:42.967479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f1c5957f-699e-4921-8469-4bbb7566cd7c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092866 Oct 05 14:17:42.968124 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 381/742] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:17:42 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:43.829177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-f9b4ab2f-1b47-4656-95d4-993f8614eafc req-c8f95a31-d5e7-4372-a921-c598f7413dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:43.838818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f9b4ab2f-1b47-4656-95d4-993f8614eafc req-c8f95a31-d5e7-4372-a921-c598f7413dc6 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:43.839304 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f9b4ab2f-1b47-4656-95d4-993f8614eafc req-c8f95a31-d5e7-4372-a921-c598f7413dc6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:43.839731 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-f9b4ab2f-1b47-4656-95d4-993f8614eafc req-c8f95a31-d5e7-4372-a921-c598f7413dc6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:43.851506 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-f9b4ab2f-1b47-4656-95d4-993f8614eafc req-c8f95a31-d5e7-4372-a921-c598f7413dc6 service nova] Creating event network-changed:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:17:43.856467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-f9b4ab2f-1b47-4656-95d4-993f8614eafc req-c8f95a31-d5e7-4372-a921-c598f7413dc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030811 Oct 05 14:17:43.859783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 362/743] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:17:43.920849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-b909868c-3568-4d64-9d8f-8ba233824a77 req-ad39e8ab-9966-4731-b67b-111d4c8460c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412dd90-2b82-4914-a28f-cc8af68472e6", "tag": "3c004758-1b5c-43fc-8097-9b75e38b9e20"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:17:43.933084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b909868c-3568-4d64-9d8f-8ba233824a77 req-ad39e8ab-9966-4731-b67b-111d4c8460c4 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:17:43.933854 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b909868c-3568-4d64-9d8f-8ba233824a77 req-ad39e8ab-9966-4731-b67b-111d4c8460c4 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:17:43.934584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-b909868c-3568-4d64-9d8f-8ba233824a77 req-ad39e8ab-9966-4731-b67b-111d4c8460c4 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:17:43.947568 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-b909868c-3568-4d64-9d8f-8ba233824a77 req-ad39e8ab-9966-4731-b67b-111d4c8460c4 service nova] Creating event network-changed:3c004758-1b5c-43fc-8097-9b75e38b9e20 for instance 0412dd90-2b82-4914-a28f-cc8af68472e6 on hv-cinder-83587 Oct 05 14:17:43.953125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-b909868c-3568-4d64-9d8f-8ba233824a77 req-ad39e8ab-9966-4731-b67b-111d4c8460c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036742 Oct 05 14:17:43.957101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 382/744] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:18:18.975976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=12 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:18.976713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=48 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:18.981641 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-62f1c5b0-98a9-4e45-98d3-dd9bdb306887 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Action: 'create', calling method: .version_select at 0x7f218ea41c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-100597262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBazW6hygEKbLGUHxXTUizQ9suMpFDDW97kpu5gDTiJoUpEscgkhjoezGRSKVFnYR85b4OR3K8KzhwNuWICBJTg+/nxuEx9k1BqOfqq8+AtSnUwhWMhKP9DxqP7L4/xdlQ=="}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:18.998938 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-62f1c5b0-98a9-4e45-98d3-dd9bdb306887 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Getting quotas for project b760d5d4e60443c48e774ea8b9837ee0. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:18:19.002809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-62f1c5b0-98a9-4e45-98d3-dd9bdb306887 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Getting quotas for user e68706a929b24c339a189e207ee375d3 and project b760d5d4e60443c48e774ea8b9837ee0. Resources: {'key_pairs'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:18:19.024300 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-62f1c5b0-98a9-4e45-98d3-dd9bdb306887 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049927 Oct 05 14:18:19.025090 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 363/745] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:18:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:19.074789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=9 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:19.075533 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=50 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:19.080596 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-406608658", "imageRef": "b6ef94dd-a4c4-4bb2-a177-d71c3f0e9434", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-100597262", "networks": [{"uuid": "6a0704de-f21b-4e6c-a27a-baec27442937"}]}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:19.134248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.network.neutron [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] validate_networks() for [('6a0704de-f21b-4e6c-a27a-baec27442937', None, None, None, None, None)] {{(pid=120645) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:18:19.712874 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Flavor limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:18:19.713325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Image limits 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:18:19.713817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Flavor pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:18:19.714221 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Image pref 0:0:0 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:18:19.714625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.virt.hardware [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:18:19.723907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:19.724246 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:19.724681 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:19.725425 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:19.725895 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:19.726284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:19.742697 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Getting quotas for project b760d5d4e60443c48e774ea8b9837ee0. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:18:19.746527 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Getting quotas for user e68706a929b24c339a189e207ee375d3 and project b760d5d4e60443c48e774ea8b9837ee0. Resources: {'instances', 'cores', 'ram'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:18:19.757584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Going to run 1 instances... {{(pid=120645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:18:19.759848 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b6ef94dd-a4c4-4bb2-a177-d71c3f0e9434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:18:19.806722 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-16488911-ba1b-4712-98f0-86947aac5138 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733624 Oct 05 14:18:19.807389 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 383/746] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:18:19.818869 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-14f7994a-0b99-4d20-9f5b-75b9260d766a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:19.819606 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-14f7994a-0b99-4d20-9f5b-75b9260d766a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:19.874590 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-14f7994a-0b99-4d20-9f5b-75b9260d766a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:19.882530 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-14f7994a-0b99-4d20-9f5b-75b9260d766a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1257 microversion: 2.1 time: 0.068199 Oct 05 14:18:19.883103 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 364/747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:19 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:20.041763 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:20.042255 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:20.049370 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:20.050073 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:20.050511 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:20.051219 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:20.051707 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:20.052140 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:20.082415 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-09308f8c-a64b-44a8-b97f-d2a5c1a613ca tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/ips" status: 200 len: 146 microversion: 2.1 time: 0.044933 Oct 05 14:18:20.082993 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 384/748] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:18:20 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:20.905833 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:20.907083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:20.916192 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:20.916741 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:20.917172 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:20.917891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:20.918499 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:20.918929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:21.004300 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:21.012017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d67f0545-342e-47fe-9e19-d78cf310d3d5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1327 microversion: 2.1 time: 0.110009 Oct 05 14:18:21.012587 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 365/749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:20 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:22.036816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:22.037602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:22.044291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:22.046807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:22.047603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:22.048479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:22.049460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:22.050643 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:22.229149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:22.237762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f323e4db-5264-4978-bd76-2c3ee924bbe2 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.204843 Oct 05 14:18:22.238837 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 385/750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:22 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:22.553978 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0243738-3e95-478d-9492-70f225cf3ebd"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:22.556427 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:22.564365 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:22.564936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:22.565343 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:22.566301 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:22.566944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:22.567530 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:23.265184 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:23.265930 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:23.272790 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:23.273296 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:23.285776 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:23.286557 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:23.287045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:23.287489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:23.423691 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:23.433677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f0346704-7823-43e7-9a1f-cae6ed486e91 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.172266 Oct 05 14:18:23.434766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 386/751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:23 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:24.459325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:24.460163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:24.467755 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:24.468249 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:24.468688 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:24.469426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:24.469886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:24.470309 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:24.617507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:24.625451 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d87a0932-9a5e-4fb7-8c97-4ce460a0d031 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.171182 Oct 05 14:18:24.626352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 387/752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:24 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:25.648620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:25.649261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:25.655711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:25.656201 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:25.656635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:25.657360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:25.657819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:25.658280 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:25.810622 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:25.824830 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-94c7b94c-5d0e-471f-b5ed-6b53f0fc6e38 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.180003 Oct 05 14:18:25.840493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 388/753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:25 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:26.850064 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:26.852089 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:26.860662 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:26.861913 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:26.863683 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:26.864692 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:26.865528 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:26.866375 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:27.010608 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:27.019231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ac36c634-1589-4f5d-8422-4d8bb16f3d03 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.174443 Oct 05 14:18:27.019790 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 389/754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:26 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:28.042840 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:28.043523 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:28.050514 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:28.051031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:28.051468 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:28.052233 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:28.052795 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:28.053286 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:28.198302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:28.207223 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-89c5776d-4d38-4906-8e1a-fcef291fa1f6 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.168235 Oct 05 14:18:28.208000 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 390/755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:28 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:29.230440 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:29.231255 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:29.238092 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:29.238576 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:29.239011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:29.239702 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:29.240179 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:29.240583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:29.373711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:29.386531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fa768c0e-8622-40d3-ae8a-a1c4116597ee tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.159860 Oct 05 14:18:29.387450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 391/756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:29 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:29.552670 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4747c297-f41b-448a-8450-477aa89757dd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.001752 Oct 05 14:18:29.554230 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 366/757] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:18:22 2022] POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-volume_attachments => generated 194 bytes in 7005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:30.046206 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-981d9ac9-85f8-42ce-8f96-ab9aee3e2d65 req-219043b9-54e9-435a-ae25-04cc09e4701a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:30.051558 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=2 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:30.052226 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=6 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:30.058685 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-981d9ac9-85f8-42ce-8f96-ab9aee3e2d65 req-219043b9-54e9-435a-ae25-04cc09e4701a service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:30.059171 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-981d9ac9-85f8-42ce-8f96-ab9aee3e2d65 req-219043b9-54e9-435a-ae25-04cc09e4701a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:30.059613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-981d9ac9-85f8-42ce-8f96-ab9aee3e2d65 req-219043b9-54e9-435a-ae25-04cc09e4701a service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:30.071599 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-981d9ac9-85f8-42ce-8f96-ab9aee3e2d65 req-219043b9-54e9-435a-ae25-04cc09e4701a service nova] Creating event network-changed:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:18:30.077314 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-981d9ac9-85f8-42ce-8f96-ab9aee3e2d65 req-219043b9-54e9-435a-ae25-04cc09e4701a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Oct 05 14:18:30.077911 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 392/758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:30.412514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:30.413181 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:30.418459 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:30.423696 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:30.424197 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:30.425334 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:30.426058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:30.426509 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:30.426929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:30.638000 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:30.646061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4420028a-e06c-4f89-b1ba-d8eab7429ebb tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.238813 Oct 05 14:18:30.646625 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 367/759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:30 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:30.753191 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bc7cada7-e946-4204-b447-eccff3ac029e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:30.762381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc7cada7-e946-4204-b447-eccff3ac029e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:30.763183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc7cada7-e946-4204-b447-eccff3ac029e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:30.763630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc7cada7-e946-4204-b447-eccff3ac029e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:30.842905 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bc7cada7-e946-4204-b447-eccff3ac029e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Going to try to stop instance {{(pid=120645) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 14:18:30.899972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bc7cada7-e946-4204-b447-eccff3ac029e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action" status: 202 len: 0 microversion: 2.1 time: 0.152294 Oct 05 14:18:30.904480 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 393/760] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:18:30 2022] POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:18:30.912191 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:30.912873 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:30.920466 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:30.921152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:30.921625 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:30.922691 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:30.923200 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:30.923643 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:31.099381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:31.107996 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-fb9f1a0f-c66a-438e-b1f2-d0fc67e4d2f2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.201172 Oct 05 14:18:31.108556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 368/761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:30 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:31.670157 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:31.670849 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:31.677461 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:31.677964 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:31.678395 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:31.679077 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:31.679526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:31.679944 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:31.808388 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:31.816012 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-273c3fbd-7d25-4040-ae3e-8e999026f0cc tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.150111 Oct 05 14:18:31.816566 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 394/762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:31 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:32.131556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:32.132187 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:32.138446 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:32.138949 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:32.139360 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:32.140041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:32.140497 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:32.140917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:32.271211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:32.279384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a6701463-7aae-4786-a4fd-d23801ddc973 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.151808 Oct 05 14:18:32.279935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 369/763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:32 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:32.840834 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:32.841501 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:32.847516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:32.847999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:32.848437 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:32.849121 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:32.849601 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:32.850029 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:32.980003 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:32.987741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-995464d8-7bec-44c7-b6f0-01587ccd045a tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.150435 Oct 05 14:18:32.988304 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 395/764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:32 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:33.303875 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:33.304485 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:33.310690 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:33.311112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:33.311548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:33.312239 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:33.312697 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:33.313127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:33.440792 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:33.448983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-cd8545db-c0d8-43c0-8124-98e2f13e6772 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.149298 Oct 05 14:18:33.449603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 370/765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:33 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:34.010287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:34.010814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:34.017113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:34.017614 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:34.018045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:34.018720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:34.019170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:34.019587 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:34.143885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:34.151407 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0f0d8077-866a-4fb3-ba89-d801ec4fd1d7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.145050 Oct 05 14:18:34.151977 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 396/766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:34 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:34.472226 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:34.472838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:34.479280 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:34.479754 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:34.480190 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:34.480864 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:34.481344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:34.481766 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:34.606955 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:34.615287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-917da54a-6ee0-4d80-b1e2-5a70aa6de7f4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.147530 Oct 05 14:18:34.615848 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 371/767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:34 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:35.174995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:35.175531 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:35.181924 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:35.182398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:35.182824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:35.183509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:35.183954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:35.184369 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:35.318311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:35.326621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-35982b40-6393-46e6-9b6b-fc2e8e20a1e5 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.156065 Oct 05 14:18:35.327222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 397/768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:35 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:35.638177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:35.638790 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:35.645149 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:35.645665 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:35.646098 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:35.646779 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:35.647234 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:35.647659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:35.777656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:35.786689 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9d84d3e3-dd9f-4b73-a85d-a4b66560c32d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.152369 Oct 05 14:18:35.787279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 372/769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:35 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:36.348460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:36.349066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:36.355422 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:36.355900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:36.356329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:36.357015 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:36.357563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:36.357981 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:36.487653 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:36.495163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ecace850-f3ee-4958-9d3f-8615d15e820e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.150514 Oct 05 14:18:36.495718 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 398/770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:36 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:36.810121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:36.810769 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:36.817794 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:36.818279 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:36.818713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:36.819393 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:36.819850 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:36.820276 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:36.950165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:36.958376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5cb71227-f563-40e8-906c-23ed3448e7c8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.152087 Oct 05 14:18:36.958945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 373/771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:36 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:37.015965 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-4d4fd0df-f3d2-4b5c-88be-59f73ac3cced req-6726245e-63cd-4ad3-a540-e1002266e6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "name": "network-vif-plugged", "status": "completed", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:37.025450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-4d4fd0df-f3d2-4b5c-88be-59f73ac3cced req-6726245e-63cd-4ad3-a540-e1002266e6a0 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:37.025932 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-4d4fd0df-f3d2-4b5c-88be-59f73ac3cced req-6726245e-63cd-4ad3-a540-e1002266e6a0 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:37.026367 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-4d4fd0df-f3d2-4b5c-88be-59f73ac3cced req-6726245e-63cd-4ad3-a540-e1002266e6a0 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:37.188085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-4d4fd0df-f3d2-4b5c-88be-59f73ac3cced req-6726245e-63cd-4ad3-a540-e1002266e6a0 service nova] Creating event network-vif-plugged:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:18:37.192909 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-4d4fd0df-f3d2-4b5c-88be-59f73ac3cced req-6726245e-63cd-4ad3-a540-e1002266e6a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180677 Oct 05 14:18:37.193547 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 399/772] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:37.518747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:37.519361 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:37.525387 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:37.525922 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:37.526361 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:37.527112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:37.527576 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:37.528006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:37.654698 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:37.662812 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8b459ef2-8d2e-4576-ac35-9567df62e225 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1357 microversion: 2.1 time: 0.148556 Oct 05 14:18:37.663370 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 374/773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:37 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:37.981717 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:37.982408 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:37.988634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:37.989116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:37.989570 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:37.990287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:37.990693 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:37.991106 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:38.114926 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:38.118459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:38.124180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-4da51493-7b97-4fb8-8330-4368fc92625b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.147091 Oct 05 14:18:38.124734 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 400/774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:37 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:38.684979 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:38.685628 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:38.691935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:38.692414 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:38.692849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:38.693633 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:38.694082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:38.694500 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:38.825576 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:38.833532 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ba92f83f-00d8-4895-a462-1f6aca05af0b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1547 microversion: 2.1 time: 0.152323 Oct 05 14:18:38.834088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 375/775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:38 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:38.855886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:38.856558 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:38.864530 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:38.865009 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:38.865466 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:38.866155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:38.866607 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:38.867030 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:38.997787 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:39.005399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fd49d71a-418e-4679-8c12-fb7ef635b26f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1547 microversion: 2.1 time: 0.153325 Oct 05 14:18:39.005983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 401/776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:38 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:39.027076 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:39.031926 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:39.032687 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Searching by: {'deleted': False, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0'} {{(pid=120646) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 14:18:39.039903 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:39.040378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:39.040811 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:39.041561 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:39.042015 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:39.042437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:39.126457 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.multi_cell_list [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120646) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 14:18:39.148197 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:39.148601 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:39.154479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:39.154965 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:39.155408 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:39.156105 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:39.156563 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:39.156987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:39.222930 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b7f23c27-4280-478e-a93c-9af716acabec tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199435 Oct 05 14:18:39.223417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 376/777] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 14:18:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:39.234716 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:39.235351 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:39.241661 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:39.242152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:39.242593 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:39.243421 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:39.243740 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:39.244169 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:39.285426 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:39.293632 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b9b3ccd7-be43-4100-96b7-f00e1eab6681 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.149534 Oct 05 14:18:39.294198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 402/778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:39 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:39.373312 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:39.381469 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b1bb4c9c-c8d8-4431-84f7-9dfd77ae12ac tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1547 microversion: 2.1 time: 0.150547 Oct 05 14:18:39.382058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 377/779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:39 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:40.317175 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:40.317817 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:40.324311 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:40.324789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:40.325259 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:40.325940 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:40.326401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:40.326824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:40.456541 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:40.464667 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-ff033e0e-2bc8-40ce-a026-1a68561c8499 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.151891 Oct 05 14:18:40.465233 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 403/780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:40 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:40.919015 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a931fafe-54c3-4dae-8235-6525524c1318"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:40.921771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:40.928684 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:40.929159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:40.929622 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:40.930300 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:40.930746 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:40.931161 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:41.229783 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:41.248141 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-712ae945-f231-48b9-b9c0-a09d8de5f485 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333277 Oct 05 14:18:41.248739 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 378/781] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:18:40 2022] POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:41.487867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:41.488497 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:41.494888 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:41.495374 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:41.495815 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:41.496510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:41.496974 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:41.497444 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:41.624701 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:41.633424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-557fe6df-5291-4697-ace2-494f6723f1d5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.149730 Oct 05 14:18:41.633989 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 404/782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:41 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:42.487706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:42.488404 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:42.494774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:42.495260 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:42.495692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:42.496374 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:42.496824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:42.497271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:42.622992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:42.631219 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f6e38956-7eef-4633-b435-29c617c9b903 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1593 microversion: 2.1 time: 0.148887 Oct 05 14:18:42.631791 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 379/783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:42 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1593 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:42.657123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:42.657759 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:42.664759 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:42.665248 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:42.665701 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:42.666391 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:42.666863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:42.667283 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:42.801262 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:42.809630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-11b8100b-e469-4fa2-9aab-1bed41463574 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.156514 Oct 05 14:18:42.810266 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 405/784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:42 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:43.833386 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:43.834017 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:43.840706 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:43.841198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:43.841669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:43.842364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:43.842821 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:43.843242 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:44.348074 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:44.356715 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-518cc8bf-28e5-4d47-86ef-71a90c9bfc24 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.528152 Oct 05 14:18:44.357393 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 380/785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:43 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:44.623987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-a35aedea-2f6e-48f2-a53c-ec911d977dc8 req-d506c069-903e-4740-b62b-99a2aa16a7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:44.634307 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a35aedea-2f6e-48f2-a53c-ec911d977dc8 req-d506c069-903e-4740-b62b-99a2aa16a7d5 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:44.635056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a35aedea-2f6e-48f2-a53c-ec911d977dc8 req-d506c069-903e-4740-b62b-99a2aa16a7d5 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:44.635679 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a35aedea-2f6e-48f2-a53c-ec911d977dc8 req-d506c069-903e-4740-b62b-99a2aa16a7d5 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:44.648034 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-a35aedea-2f6e-48f2-a53c-ec911d977dc8 req-d506c069-903e-4740-b62b-99a2aa16a7d5 service nova] Creating event network-changed:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:18:44.654001 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-a35aedea-2f6e-48f2-a53c-ec911d977dc8 req-d506c069-903e-4740-b62b-99a2aa16a7d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033398 Oct 05 14:18:44.654595 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 406/786] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:45.380625 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:45.381252 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:45.387747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:45.388228 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:45.388657 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:45.389381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:45.389854 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:45.390471 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:45.579508 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:45.588566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bbed7ee4-1a7a-4580-b574-3793ed21b683 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1723 microversion: 2.1 time: 0.212382 Oct 05 14:18:45.589758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 381/787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:45 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:45.683305 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-152545069"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:45.683961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:45.691680 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:45.692172 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:45.692613 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:45.693340 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:45.693796 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:45.694221 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:45.827231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.network.security_group_api [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Adding security group 615c810a-edaa-4e41-9d46-1c30e71c292c to port da04e29b-7a27-47b3-ad93-c07afada7291 Oct 05 14:18:46.208286 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a22185e2-5c53-4dfa-a0bb-174dfc8d1a97 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/action" status: 202 len: 0 microversion: 2.1 time: 0.529189 Oct 05 14:18:46.209187 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 407/788] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:18:45 2022] POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:18:46.224116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-fb2e32d9-7dcc-4e52-a789-bb807da25759 req-e4461acd-de90-4845-8fa4-258e1680aa4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:46.226483 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:46.227183 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:46.238932 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.242920 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.245371 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-fb2e32d9-7dcc-4e52-a789-bb807da25759 req-e4461acd-de90-4845-8fa4-258e1680aa4d service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.246052 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.246894 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.247470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.248072 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-fb2e32d9-7dcc-4e52-a789-bb807da25759 req-e4461acd-de90-4845-8fa4-258e1680aa4d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.248604 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.249139 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-fb2e32d9-7dcc-4e52-a789-bb807da25759 req-e4461acd-de90-4845-8fa4-258e1680aa4d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.274548 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-fb2e32d9-7dcc-4e52-a789-bb807da25759 req-e4461acd-de90-4845-8fa4-258e1680aa4d service nova] Creating event network-changed:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:18:46.280729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-fb2e32d9-7dcc-4e52-a789-bb807da25759 req-e4461acd-de90-4845-8fa4-258e1680aa4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062024 Oct 05 14:18:46.289384 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 408/789] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:18:46.526004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:46.535366 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-08385d1f-5c45-4425-9ee7-57b665f6940b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1757 microversion: 2.1 time: 0.321491 Oct 05 14:18:46.535947 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 382/790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:46 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1757 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:46.613670 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:46.614878 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:46.620962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.621500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.621939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.622631 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.623301 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.623953 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.774751 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:46.789723 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a55fbbc3-e8c4-4ed4-aecf-e9e3fdc064a5 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1700 microversion: 2.1 time: 0.181010 Oct 05 14:18:46.790652 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 409/791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:46 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:46.811988 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-45c80c77-c5da-4d17-adbd-db3eb2e13746 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:18:46.818709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-45c80c77-c5da-4d17-adbd-db3eb2e13746 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.819196 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-45c80c77-c5da-4d17-adbd-db3eb2e13746 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.819636 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-45c80c77-c5da-4d17-adbd-db3eb2e13746 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.879194 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-45c80c77-c5da-4d17-adbd-db3eb2e13746 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Going to try to start instance {{(pid=120646) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 14:18:46.922867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-45c80c77-c5da-4d17-adbd-db3eb2e13746 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action" status: 202 len: 0 microversion: 2.1 time: 0.114663 Oct 05 14:18:46.923498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 383/792] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:18:46 2022] POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:18:46.932165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:46.932991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:46.940499 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.941167 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.943653 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:46.944370 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:46.944935 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:46.945535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:47.104095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:47.112878 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-00af36dd-c487-4081-ba72-e7277370a603 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1709 microversion: 2.1 time: 0.184914 Oct 05 14:18:47.114045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 410/793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:46 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:18:48.137692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:48.138395 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:48.144981 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:48.145504 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:48.145944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:48.146659 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:48.147116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:48.147540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:48.278558 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:48.287713 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7567a9d9-8e10-4a1e-8a74-f2cee023bebd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1709 microversion: 2.1 time: 0.154654 Oct 05 14:18:48.288344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 384/794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:48 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:18:49.311291 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:18:49.311910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:18:49.314437 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:49.319606 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:49.320090 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:49.320523 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:49.321205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:18:49.321678 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:18:49.322095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:18:49.450388 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:18:49.459075 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1d82a117-f61d-499e-afae-eb7198db6583 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1713 microversion: 2.1 time: 0.151810 Oct 05 14:18:49.459635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 411/795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:18:49 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:12.141869 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:12.144063 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:12.146062 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:12.147881 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:12.148545 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:12.155144 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:12.155629 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:12.156060 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:12.156748 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:12.157199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:12.157642 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:12.229543 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2925e238-0b64-48fc-a14b-a772f0e96155 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/action" status: 202 len: 0 microversion: 2.1 time: 0.091359 Oct 05 14:19:12.230172 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 385/796] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:19:12 2022] POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:12.239334 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:12.240556 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:12.243198 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:12.244082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=56 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:12.249040 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:12.249546 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:12.249980 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:12.251408 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:12.251843 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:12.252360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:12.402997 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:12.412072 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9726c441-240f-4b75-a888-2cdc570fa192 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1749 microversion: 2.1 time: 0.177686 Oct 05 14:19:12.412638 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 412/797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:12 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:19:13.436700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:13.437414 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:13.443987 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:13.444492 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:13.444919 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:13.445626 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:13.446107 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:13.446528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:13.584097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:13.592116 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ea34ed0f-99d9-48ba-9070-66e713d6a086 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.160062 Oct 05 14:19:13.592664 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 386/798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:13 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:14.617586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:14.618712 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:14.625158 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:14.626178 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:14.626619 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:14.627325 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:14.627785 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:14.628215 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:14.768034 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:14.776503 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-be1d4637-760c-4a91-80c6-3473ef3117f0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.165215 Oct 05 14:19:14.777060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 413/799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:14 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:15.799541 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:15.800186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:15.806588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:15.807072 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:15.807510 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:15.808199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:15.808656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:15.809082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:15.948647 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:15.957253 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-820c0161-50b0-467b-8c31-02a4d8abc314 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.161540 Oct 05 14:19:15.957812 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 387/800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:15 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:16.980540 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:16.981154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:16.988402 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:16.988885 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:16.989353 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:16.990045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:16.990502 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:16.990925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:17.127155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:17.135165 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0e959661-f693-47d3-91c6-bc01ede0cfa0 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.158491 Oct 05 14:19:17.135730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 414/801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:16 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:18.158901 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:18.159443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:18.165833 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:18.166317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:18.166753 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:18.167435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:18.167890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:18.168313 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:18.310983 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:18.319040 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-48373aa7-bbfb-4a6b-a1d4-e06020d25968 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.164109 Oct 05 14:19:18.319601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 388/802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:18 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:19.342375 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:19.342987 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:19.349358 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:19.349845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:19.350285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:19.350972 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:19.351429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:19.351851 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:19.494676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:19.503336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0cd3f118-8907-4a44-b26e-065d0bc068ff tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.164815 Oct 05 14:19:19.503899 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 415/803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:19 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:20.527905 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:20.528522 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:20.535433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:20.535919 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:20.536356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:20.537044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:20.537543 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:20.537969 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:20.676865 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:20.684980 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c17a58a8-e9d0-41d9-8014-d1a5d51b04b4 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.160985 Oct 05 14:19:20.685565 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 389/804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:20 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:21.707752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:21.708367 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:21.714925 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:21.715432 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:21.715867 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:21.716556 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:21.717012 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:21.717463 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:21.856516 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:21.865456 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-42221ba4-4537-4697-91fe-29ac475a6e19 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.161496 Oct 05 14:19:21.866014 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 416/805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:21 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:21.989330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:21.989855 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:21.996180 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:21.996668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:21.997112 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:21.997826 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:21.998286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:21.998716 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:22.078177 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lazy-loading 'services' on Instance uuid 0412dd90-2b82-4914-a28f-cc8af68472e6 {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:19:22.147468 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0862cc44-eb1a-4ec0-8630-44ceff1a433e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-volume_attachments/c0243738-3e95-478d-9492-70f225cf3ebd" status: 202 len: 0 microversion: 2.1 time: 0.162733 Oct 05 14:19:22.151180 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 390/806] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:19:21 2022] DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-volume_attachments/c0243738-3e95-478d-9492-70f225cf3ebd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:22.888926 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:22.889555 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:22.896515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:22.896988 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:22.897450 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:22.898149 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:22.898603 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:22.899019 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:23.040574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:23.048703 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-883b8dcf-dfb3-45a3-b10c-67f9a2507fd3 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1754 microversion: 2.1 time: 0.163669 Oct 05 14:19:23.049285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 417/807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:22 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:23.274871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6f3c3723-4e74-4714-a93d-dce5386bb301 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:23.281001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6f3c3723-4e74-4714-a93d-dce5386bb301 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:23.281515 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6f3c3723-4e74-4714-a93d-dce5386bb301 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:23.281952 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6f3c3723-4e74-4714-a93d-dce5386bb301 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:23.305268 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6f3c3723-4e74-4714-a93d-dce5386bb301 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Going to try to stop instance {{(pid=120646) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 14:19:23.346153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6f3c3723-4e74-4714-a93d-dce5386bb301 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action" status: 202 len: 0 microversion: 2.1 time: 0.075851 Oct 05 14:19:23.346745 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 391/808] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:19:23 2022] POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:23.354928 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:23.355543 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:23.362290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:23.363044 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:23.363489 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:23.364183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:23.364795 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:23.365253 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:23.492084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:23.499709 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7b15f1dc-a080-4d95-95e1-9dc04871a71d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.148589 Oct 05 14:19:23.500943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 418/809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:23 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:24.072519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:24.073130 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:24.079794 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:24.080274 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:24.080707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:24.081410 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:24.081929 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:24.082349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:24.226357 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:24.234599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d156fb05-1d02-44d7-ac67-d150584cad42 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1757 microversion: 2.1 time: 0.166374 Oct 05 14:19:24.235202 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 392/810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:24 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:24.523572 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:24.524176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:24.530504 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:24.530982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:24.531935 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:24.532842 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:24.533331 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:24.533757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:24.661930 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:24.669537 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c58b63b7-788b-4fad-be98-f0525e8b5944 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.149788 Oct 05 14:19:24.670097 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 419/811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:24 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:25.692918 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:25.693490 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:25.699835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:25.700325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:25.700762 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:25.701491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:25.701948 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:25.702373 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:25.828957 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:25.836817 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c888f56a-7d2b-415d-8ea5-8bdb11f398be tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.147853 Oct 05 14:19:25.837421 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 393/812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:25 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:26.860180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:26.860793 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:26.867459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:26.867938 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:26.868372 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:26.869056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:26.869535 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:26.869961 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:26.998911 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:27.007045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-952d13d8-f525-472b-9720-b12cd142cee7 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.150742 Oct 05 14:19:27.007621 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 420/813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:26 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:28.029798 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:28.030330 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:28.037152 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:28.037668 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:28.038109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:28.038795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:28.039254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:28.039683 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:28.172931 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:28.181484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-246ecd7f-44db-4fa6-afaf-4f9e22ad9895 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.155496 Oct 05 14:19:28.182055 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 394/814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:28 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:29.204912 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:29.205481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:29.211793 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:29.212278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:29.212720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:29.213448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:29.213910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:29.214359 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:29.342377 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:29.350762 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-06bf4d27-9943-4a4a-84bf-b1097c2dcd12 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.150346 Oct 05 14:19:29.351334 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 421/815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:29 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:30.373699 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:30.374285 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:30.381037 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:30.381541 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:30.381972 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:30.382646 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:30.383097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:30.383513 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:30.667859 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:30.676127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b499aa34-69b5-4d16-9f5a-888ace865a98 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.305972 Oct 05 14:19:30.677087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 395/816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:30 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:31.701007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:31.701718 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:31.708546 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:31.709036 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:31.709519 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:31.710196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:31.710650 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:31.711076 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:31.842507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:31.850628 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3edf1746-c19e-4278-b6b4-46cdf3ce1a52 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.153467 Oct 05 14:19:31.851193 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 422/817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:31 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:32.874272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:32.874809 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:32.881830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:32.882313 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:32.882750 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:32.883434 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:32.883891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:32.884316 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:33.010439 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:33.018520 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6fb16a9a-1cce-49e0-b89e-07c2b8334ce4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1677 microversion: 2.1 time: 0.148188 Oct 05 14:19:33.019067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 396/818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:32 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:34.042082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:34.042634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:34.050082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:34.050575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:34.051017 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:34.051710 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:34.052171 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:34.052600 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:34.177448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:34.185056 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-342b258b-91e4-45d1-b6f3-19c45f218bd2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1654 microversion: 2.1 time: 0.146902 Oct 05 14:19:34.185673 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 423/819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:34 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:34.207153 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ce025f7c-a571-4bfc-a48a-e861c21adc45 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:34.213698 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ce025f7c-a571-4bfc-a48a-e861c21adc45 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:34.214186 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ce025f7c-a571-4bfc-a48a-e861c21adc45 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:34.214624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ce025f7c-a571-4bfc-a48a-e861c21adc45 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:34.237097 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ce025f7c-a571-4bfc-a48a-e861c21adc45 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Going to try to start instance {{(pid=120646) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 14:19:34.271679 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:34.284286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ce025f7c-a571-4bfc-a48a-e861c21adc45 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action" status: 202 len: 0 microversion: 2.1 time: 0.080784 Oct 05 14:19:34.284889 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 397/820] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:19:34 2022] POST /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:34.293374 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:34.293926 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:34.300768 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:34.301485 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:34.301927 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:34.302624 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:34.303083 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:34.303509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:34.442217 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:34.449991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e426ecd1-f450-4926-b458-8fd3d451d387 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1663 microversion: 2.1 time: 0.160543 Oct 05 14:19:34.450586 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 424/821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:34 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:35.475197 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:35.475924 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:35.481995 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:35.482474 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:35.482904 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:35.483589 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:35.484040 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:35.484462 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:35.614927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:35.622588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-81be9a2c-f56d-4359-92b6-923ac91512f8 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1663 microversion: 2.1 time: 0.153007 Oct 05 14:19:35.623138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 398/822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:35 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:36.646515 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:36.647125 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:36.653493 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:36.653973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:36.654431 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:36.655113 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:36.655566 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:36.655985 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:36.783595 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:36.791410 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-84f7f635-b4bf-49f0-bbc0-448ec4c4e7a3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1667 microversion: 2.1 time: 0.149230 Oct 05 14:19:36.791969 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 425/823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:36 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:38.437325 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:38.437881 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:38.444899 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:38.445425 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:38.445868 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:38.446559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:38.447014 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:38.447441 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:38.469313 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lazy-loading 'flavor' on Instance uuid 0ce46222-85a1-40c3-bebc-103c7c71b7f4 {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:19:38.541030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9bde004e-e399-4f0f-bf85-c2db49f51a0e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "POST /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.107443 Oct 05 14:19:38.541638 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 399/824] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:19:38 2022] POST /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:38.550383 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:38.551561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:38.558131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:38.558605 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:38.559033 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:38.559766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:38.560221 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:38.560640 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:38.689900 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:38.697562 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-b1d353a0-9c1c-4ed4-b378-4c7dec60d7d7 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.151610 Oct 05 14:19:38.698137 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 426/825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:38 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:39.724872 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:39.725599 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:39.731772 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:39.732257 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:39.732695 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:39.733416 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:39.733874 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:39.734298 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:39.866158 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:39.873853 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-6d3f5fd3-81d1-4179-96fd-cec701401cea tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.153653 Oct 05 14:19:39.874413 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 400/826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:39 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:40.897084 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:40.897725 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:40.904089 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:40.904567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:40.904998 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:40.905711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:40.906163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:40.906584 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:41.035091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:41.042826 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-75db07c9-a14f-4532-b764-2739215056e5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.149496 Oct 05 14:19:41.043324 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 427/827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:40 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:42.065801 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:42.066339 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:42.072867 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:42.073391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:42.073830 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:42.074548 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:42.075001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:42.075422 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:42.207089 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:42.214760 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-95cec33f-a279-4e6a-99a3-a86f9c7f22cd tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.152927 Oct 05 14:19:42.215317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 401/828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:42 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:43.238636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:43.239264 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:43.241574 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=33 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:43.246770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:43.247254 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:43.247694 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:43.248390 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:43.248848 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:43.249316 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:43.252534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=97 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:43.378026 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:43.385967 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-a1f5c97f-b4a5-40ec-836d-d41d5292ebaf tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.151340 Oct 05 14:19:43.386536 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 428/829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:43 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:44.408890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:44.409524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:44.412051 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=35 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:44.417140 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:44.417650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:44.418083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:44.418762 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:44.419214 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:44.419632 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:44.549544 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:44.557038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5eb4de80-6579-48db-9662-c17e67c5b2b8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.152027 Oct 05 14:19:44.557631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 402/830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:44 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:45.580647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:45.581285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:45.587884 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:45.588365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:45.588791 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:45.589502 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:45.589954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:45.590370 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:45.723864 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:45.732196 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-fa6d2518-0f9c-4a0b-9ecf-0b05d0ef1e89 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.156082 Oct 05 14:19:45.732769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 429/831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:45 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:46.756322 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:46.756914 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:46.763252 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:46.763764 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:46.764208 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:46.764900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:46.765391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:46.765819 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:46.895326 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:46.902994 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-53966eac-0bbd-4550-b621-fbd3e5a56df3 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.150594 Oct 05 14:19:46.903561 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 403/832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:46 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:47.925460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:47.926074 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:47.932480 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:47.932968 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:47.933429 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:47.934114 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:47.934570 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:47.934994 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:48.063045 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:48.070750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-757dacb6-f83b-4c91-9e18-11a6e4571a9a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.149680 Oct 05 14:19:48.071313 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 430/833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:47 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:49.094082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:49.095283 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:49.101655 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:49.102136 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:49.102573 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:49.103263 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:49.103720 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:49.104151 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:49.234965 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:49.242864 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-1732015a-fb94-412e-83d6-de8d28d8e412 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.152727 Oct 05 14:19:49.243435 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 404/834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:49 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:50.266750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:50.267420 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:50.273809 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:50.274290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:50.274726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:50.275410 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:50.275863 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:50.276287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:50.402627 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:50.410814 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-dea545cb-897d-4db5-96d6-473dcc2f830f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.147958 Oct 05 14:19:50.411399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 431/835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:50 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:51.433349 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:51.433960 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:51.442154 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:51.443006 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:51.443797 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:51.444940 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:51.445736 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:51.446451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:51.575795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:51.584516 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-b4b2859b-ba24-4f49-819f-9ba919a468b5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.155026 Oct 05 14:19:51.585068 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 405/836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:51 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:52.607819 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:52.608424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:52.615049 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:52.615523 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:52.615952 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:52.616626 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:52.617076 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:52.617526 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:52.749186 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:52.757497 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f7cb8eac-62e1-48b8-a331-a191a4730e27 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.153437 Oct 05 14:19:52.758066 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 432/837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:52 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:53.780605 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:53.781238 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:53.788243 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:53.788502 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:53.788937 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:53.789662 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:53.790117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:53.790535 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:53.994729 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:54.002396 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d1c0f2a4-de8b-45cb-a215-e69af01c1447 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.225794 Oct 05 14:19:54.002951 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 406/838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:53 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:55.026150 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:55.026771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:55.033850 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:55.034339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:55.034780 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:55.035476 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:55.035935 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:55.036361 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:55.163962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:55.171676 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bf607d03-5cd4-4b78-ab6c-3e6854f3fe78 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.149409 Oct 05 14:19:55.172240 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 433/839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:55 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:56.194978 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:56.195594 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:56.203400 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:56.204394 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:56.204852 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:56.205567 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:56.206026 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:56.206447 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:56.342082 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:56.349863 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ad1597c8-9e41-46b0-98be-a114c14b29a0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.158777 Oct 05 14:19:56.350418 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 407/840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:56 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:56.736996 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-152545069"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:56.737558 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:56.743982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:56.744460 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:56.744890 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:56.745602 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:56.746055 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:56.746472 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:56.875031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.network.security_group_api [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Removing security group 615c810a-edaa-4e41-9d46-1c30e71c292c from port da04e29b-7a27-47b3-ad93-c07afada7291 Oct 05 14:19:57.182371 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9592b552-b34d-4424-a31c-c88ab17150bf tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/action" status: 202 len: 0 microversion: 2.1 time: 0.449377 Oct 05 14:19:57.182985 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 434/841] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:19:56 2022] POST /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:57.195160 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-ab16ee1b-8970-4586-93c0-195d360e2ffa req-47f81834-ff8b-4ed5-aba4-343e8386ffd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:57.206975 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-ab16ee1b-8970-4586-93c0-195d360e2ffa req-47f81834-ff8b-4ed5-aba4-343e8386ffd0 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.208145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-ab16ee1b-8970-4586-93c0-195d360e2ffa req-47f81834-ff8b-4ed5-aba4-343e8386ffd0 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.208837 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-ab16ee1b-8970-4586-93c0-195d360e2ffa req-47f81834-ff8b-4ed5-aba4-343e8386ffd0 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:57.224879 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-ab16ee1b-8970-4586-93c0-195d360e2ffa req-47f81834-ff8b-4ed5-aba4-343e8386ffd0 service nova] Creating event network-changed:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:19:57.230030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-ab16ee1b-8970-4586-93c0-195d360e2ffa req-47f81834-ff8b-4ed5-aba4-343e8386ffd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 Oct 05 14:19:57.230631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 408/842] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:19:57.373726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:57.374697 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:57.382095 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.382661 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.383364 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:57.384278 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.384832 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.385387 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:57.562550 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:57.572713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f015cac9-23e7-4de6-bdec-abcc9eb55ef0 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1507 microversion: 2.1 time: 0.203313 Oct 05 14:19:57.573781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 435/843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:57 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:57.596182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:57.597129 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:57.603521 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.604022 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.604460 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:57.605175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.605660 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.606092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:57.637669 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120646) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 14:19:57.711554 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a433ca80-2262-4595-9add-21f5086d907e tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "POST /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.119570 Oct 05 14:19:57.712688 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 409/844] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 14:19:57 2022] POST /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:57.720544 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:57.721625 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:57.727956 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.728646 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.729277 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:57.730151 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:57.730770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:57.731359 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:58.036590 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:58.044991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e4fb0318-e86c-478b-b1ca-afb84d07c1fe tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1515 microversion: 2.1 time: 0.328356 Oct 05 14:19:58.045652 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 436/845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:57 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:58.814533 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:58.815185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:58.822211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:58.822919 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:58.823416 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:58.824132 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:58.824758 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:58.825364 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:58.921542 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.objects.instance [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lazy-loading 'services' on Instance uuid 4f40c42e-bf27-42a1-8344-6d8594eeedcc {{(pid=120646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:19:58.999083 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-cd2eb1d0-221c-48b4-8cbb-4bb0454e3f1c tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments/a931fafe-54c3-4dae-8235-6525524c1318" status: 202 len: 0 microversion: 2.1 time: 0.189312 Oct 05 14:19:58.999967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 410/846] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:19:58 2022] DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments/a931fafe-54c3-4dae-8235-6525524c1318 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:19:59.009789 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:59.013253 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:59.020711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:59.021801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:59.022224 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:59.023155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:59.023984 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:59.024575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:59.056258 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-2e55d1b1-320c-4984-9bd1-a6cd97421570 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051463 Oct 05 14:19:59.056942 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 437/847] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:19:59 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:19:59.068967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:19:59.069714 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:19:59.076378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:59.076864 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:59.077340 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:59.078041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:59.079107 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:59.079769 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:59.098935 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:59.217119 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:19:59.225526 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-35bfcd7c-049e-46a4-a87d-5de91c62160c tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1573 microversion: 2.1 time: 0.161015 Oct 05 14:19:59.226092 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 411/848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:19:59 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:19:59.245807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-68e6f29b-02b5-4ed2-a77d-632179c34b53 req-884b6354-2f78-4c07-8392-59b80cb8d50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:59.253340 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 14:19:59.253580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Wed Oct 5 14:19:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 14:19:59.260798 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-68e6f29b-02b5-4ed2-a77d-632179c34b53 req-884b6354-2f78-4c07-8392-59b80cb8d50d service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:59.261549 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-68e6f29b-02b5-4ed2-a77d-632179c34b53 req-884b6354-2f78-4c07-8392-59b80cb8d50d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:59.261980 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-68e6f29b-02b5-4ed2-a77d-632179c34b53 req-884b6354-2f78-4c07-8392-59b80cb8d50d service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:59.274170 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-68e6f29b-02b5-4ed2-a77d-632179c34b53 req-884b6354-2f78-4c07-8392-59b80cb8d50d service nova] Creating event network-changed:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:19:59.279498 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-68e6f29b-02b5-4ed2-a77d-632179c34b53 req-884b6354-2f78-4c07-8392-59b80cb8d50d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037730 Oct 05 14:19:59.280231 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 438/849] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:19:59.604164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-edb67a15-6e91-4391-b88c-bc8fa4257921 req-4f0dbb55-b8d1-49cb-b2a5-2ef968fd3f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "name": "network-vif-unplugged", "status": "completed", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:19:59.616794 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-edb67a15-6e91-4391-b88c-bc8fa4257921 req-4f0dbb55-b8d1-49cb-b2a5-2ef968fd3f99 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:19:59.617133 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-edb67a15-6e91-4391-b88c-bc8fa4257921 req-4f0dbb55-b8d1-49cb-b2a5-2ef968fd3f99 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:19:59.617603 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-edb67a15-6e91-4391-b88c-bc8fa4257921 req-4f0dbb55-b8d1-49cb-b2a5-2ef968fd3f99 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:19:59.646516 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-edb67a15-6e91-4391-b88c-bc8fa4257921 req-4f0dbb55-b8d1-49cb-b2a5-2ef968fd3f99 service nova] Creating event network-vif-unplugged:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:19:59.651561 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-edb67a15-6e91-4391-b88c-bc8fa4257921 req-4f0dbb55-b8d1-49cb-b2a5-2ef968fd3f99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051198 Oct 05 14:19:59.652480 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 412/850] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:00.071500 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:00.073923 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:00.081148 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:00.081672 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:00.082105 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:00.082799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:00.083285 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:00.083702 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:00.113644 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-214bb690-f7d8-407f-8273-e2cb59b3f5c1 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046904 Oct 05 14:20:00.114222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 439/851] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:20:00 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:20:00.127768 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:00.128376 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:00.134737 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:00.135233 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:00.135698 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:00.136401 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:00.136863 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:00.137314 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:00.212062 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] HTTP exception thrown: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc is not attached to volume a931fafe-54c3-4dae-8235-6525524c1318 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Request method failure captured: Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments/a931fafe-54c3-4dae-8235-6525524c1318 HTTP/1.1 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZIdbGvKmQrAN-5o3DMVr88TJPynvKLTFRPhHHZcrKOOP8bh6OP6K_YcljkVzFYHweWN7L_OMn48NmHy1jZrfefmQSl2lfXYTcVc80VnxQxm6xDJcGsOEK1K53wDV6z25nBBDBUOEPFYd7ivzIw0n7QXXSwrZwON14TCPE-EOETNcmk Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b760d5d4e60443c48e774ea8b9837ee0 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-TestMinimumBasicScenario-50757215 Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:20:00.214482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b760d5d4e60443c48e774ea8b9837ee0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b760d5d4e60443c48e774ea8b9837ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b760d5d4e60443c48e774ea8b9837ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b760d5d4e60443c48e774ea8b9837ee0"}]}] Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-TestMinimumBasicScenario-50757215 Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b760d5d4e60443c48e774ea8b9837ee0 Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-TestMinimumBasicScenario-50757215 Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-TestMinimumBasicScenario-50757215-project Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: e68706a929b24c339a189e207ee375d3 Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-TestMinimumBasicScenario-50757215-project Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:20:00.216138 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc is not attached to volume a931fafe-54c3-4dae-8235-6525524c1318 Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'server_id': '4f40c42e-bf27-42a1-8344-6d8594eeedcc', 'id': 'a931fafe-54c3-4dae-8235-6525524c1318'} Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a931fafe-54c3-4dae-8235-6525524c1318. Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:20:00.216891 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc is not attached to volume a931fafe-54c3-4dae-8235-6525524c1318 Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc is not attached to volume a931fafe-54c3-4dae-8235-6525524c1318 Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:00.218261 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Returning 404 to user: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc is not attached to volume a931fafe-54c3-4dae-8235-6525524c1318 {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:20:00.219789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-a494ee42-c3fa-4b35-b5b8-7ef656de5a6f tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments/a931fafe-54c3-4dae-8235-6525524c1318" status: 404 len: 154 microversion: 2.1 time: 0.094705 Oct 05 14:20:00.219789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 413/852] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:20:00 2022] DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc/os-volume_attachments/a931fafe-54c3-4dae-8235-6525524c1318 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:20:00.247706 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:00.248335 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:00.254261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:00.254752 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:00.255235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:00.256490 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:00.257152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:00.257668 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:00.399545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:00.407974 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d8eb248e-ead3-4349-a998-8fabe4ea25c8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1573 microversion: 2.1 time: 0.164082 Oct 05 14:20:00.408538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 440/853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:00 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:01.363812 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:01.364309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:01.370641 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:01.371126 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:01.371554 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:01.372234 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:01.372681 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:01.373101 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:01.397967 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:20:01.433183 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:01.433865 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:01.441163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:01.441626 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:01.442051 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:01.442743 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:01.443204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:01.443629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:01.473917 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7340be64-fe5d-4f37-bcec-50a2309c708b tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 204 len: 0 microversion: 2.1 time: 0.113810 Oct 05 14:20:01.474887 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 414/854] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:20:01 2022] DELETE /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:20:01.484375 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:01.485871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:01.491900 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:01.492393 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:01.492835 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:01.493566 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:01.494021 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:01.494449 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:01.578254 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:01.586103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8286d2be-5ebf-49bd-99e3-536b4958351a tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1573 microversion: 2.1 time: 0.156836 Oct 05 14:20:01.586671 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 441/855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:01 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:20:01.627344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:01.634950 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f4b3a496-6c84-4e57-af5d-d691cb7f326e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1553 microversion: 2.1 time: 0.154935 Oct 05 14:20:01.635509 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 415/856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:01 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:02.607973 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:02.608620 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:02.615400 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:02.615886 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:02.616320 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:02.617008 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:02.617510 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:02.617939 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:02.658421 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:02.659038 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:02.665381 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:02.665870 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:02.666309 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:02.667004 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:02.667461 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:02.667890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:02.747115 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:02.755462 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-d0db26e0-826f-4b96-bd08-36aa6b75af59 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1573 microversion: 2.1 time: 0.151502 Oct 05 14:20:02.756035 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 442/857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:02 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:02.798677 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:02.806241 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-be8b88ee-d831-4d4e-b20e-d74f8c69d0b7 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1553 microversion: 2.1 time: 0.152128 Oct 05 14:20:02.806793 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 416/858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:02 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:20:03.778704 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:03.779326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:03.785813 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:03.786360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:03.786808 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:03.787564 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:03.787948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:03.788374 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:03.830771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:03.831391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:03.838164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:03.838654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:03.839088 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:03.839789 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:03.840240 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:03.840661 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:03.926031 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:03.934163 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e3ed8989-9b56-44fd-8937-d69b436340a4 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1560 microversion: 2.1 time: 0.159260 Oct 05 14:20:03.934741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 443/859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:03 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:03.972907 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68706a929b24c339a189e207ee375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b760d5d4e60443c48e774ea8b9837ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:03.980774 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-75b577ca-a8e9-43a8-9aac-f7b5650f153e tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 200 len: 1553 microversion: 2.1 time: 0.154593 Oct 05 14:20:03.989990 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 417/860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:03 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:20:04.404204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-e0f3d066-a1cf-44ce-a64d-2f67edfadd5e req-12f48669-607a-4fb2-820c-9b7c98ae8ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c42e-bf27-42a1-8344-6d8594eeedcc", "name": "network-vif-deleted", "tag": "da04e29b-7a27-47b3-ad93-c07afada7291"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:04.414277 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e0f3d066-a1cf-44ce-a64d-2f67edfadd5e req-12f48669-607a-4fb2-820c-9b7c98ae8ae1 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:04.414760 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e0f3d066-a1cf-44ce-a64d-2f67edfadd5e req-12f48669-607a-4fb2-820c-9b7c98ae8ae1 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:04.415194 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e0f3d066-a1cf-44ce-a64d-2f67edfadd5e req-12f48669-607a-4fb2-820c-9b7c98ae8ae1 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:04.429714 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-e0f3d066-a1cf-44ce-a64d-2f67edfadd5e req-12f48669-607a-4fb2-820c-9b7c98ae8ae1 service nova] Creating event network-vif-deleted:da04e29b-7a27-47b3-ad93-c07afada7291 for instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc on hv-cinder-83587 Oct 05 14:20:04.431347 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-e0f3d066-a1cf-44ce-a64d-2f67edfadd5e req-12f48669-607a-4fb2-820c-9b7c98ae8ae1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Oct 05 14:20:04.432087 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 444/861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:05.013291 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:05.013912 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] [instance: 4f40c42e-bf27-42a1-8344-6d8594eeedcc] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:05.020897 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:05.021433 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:05.021902 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:05.022588 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:05.023043 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:05.023467 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:05.036383 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] HTTP exception thrown: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc could not be found. Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Request method failure captured: Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc HTTP/1.1 Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZIdbGvKmQrAN-5o3DMVr88TJPynvKLTFRPhHHZcrKOOP8bh6OP6K_YcljkVzFYHweWN7L_OMn48NmHy1jZrfefmQSl2lfXYTcVc80VnxQxm6xDJcGsOEK1K53wDV6z25nBBDBUOEPFYd7ivzIw0n7QXXSwrZwON14TCPE-EOETNcmk Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: b760d5d4e60443c48e774ea8b9837ee0 Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-TestMinimumBasicScenario-50757215 Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:20:05.038029 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b760d5d4e60443c48e774ea8b9837ee0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b760d5d4e60443c48e774ea8b9837ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b760d5d4e60443c48e774ea8b9837ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b760d5d4e60443c48e774ea8b9837ee0"}]}] Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-TestMinimumBasicScenario-50757215 Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: b760d5d4e60443c48e774ea8b9837ee0 Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-TestMinimumBasicScenario-50757215 Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-TestMinimumBasicScenario-50757215-project Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: e68706a929b24c339a189e207ee375d3 Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-TestMinimumBasicScenario-50757215-project Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc could not be found. Oct 05 14:20:05.039619 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '4f40c42e-bf27-42a1-8344-6d8594eeedcc'} Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc could not be found. Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:20:05.040478 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc could not be found. Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc could not be found. Oct 05 14:20:05.041992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:20:05.043420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Returning 404 to user: Instance 4f40c42e-bf27-42a1-8344-6d8594eeedcc could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:20:05.043420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0a810427-c684-491d-afaa-d6282e75e2da tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc" status: 404 len: 111 microversion: 2.1 time: 0.030001 Oct 05 14:20:05.043420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 418/862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:05 2022] GET /compute/v2.1/servers/4f40c42e-bf27-42a1-8344-6d8594eeedcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:20:05.049109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-893f92b7-0f1a-4771-80ed-3f15a541cdc9 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] Calling method '.version_select at 0x7f218d048ca0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:05.071020 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-893f92b7-0f1a-4771-80ed-3f15a541cdc9 tempest-TestMinimumBasicScenario-50757215 tempest-TestMinimumBasicScenario-50757215-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-100597262" status: 202 len: 0 microversion: 2.1 time: 0.026521 Oct 05 14:20:05.071617 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 445/863] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 14:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-100597262 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:20:05.526707 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-a3a2b9ca-c35c-4ad3-b8b2-cd721e162b21 req-ce330828-449e-4d20-9d95-debbbf53c0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "name": "network-vif-plugged", "status": "completed", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:05.537125 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-a3a2b9ca-c35c-4ad3-b8b2-cd721e162b21 req-ce330828-449e-4d20-9d95-debbbf53c0ba service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:05.537678 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-a3a2b9ca-c35c-4ad3-b8b2-cd721e162b21 req-ce330828-449e-4d20-9d95-debbbf53c0ba service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:05.538109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-a3a2b9ca-c35c-4ad3-b8b2-cd721e162b21 req-ce330828-449e-4d20-9d95-debbbf53c0ba service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:05.552824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-a3a2b9ca-c35c-4ad3-b8b2-cd721e162b21 req-ce330828-449e-4d20-9d95-debbbf53c0ba service nova] Creating event network-vif-plugged:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:20:05.562498 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-a3a2b9ca-c35c-4ad3-b8b2-cd721e162b21 req-ce330828-449e-4d20-9d95-debbbf53c0ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036589 Oct 05 14:20:05.563397 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 419/864] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:09.319674 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:09.321995 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:09.328746 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:09.329251 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:09.329702 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:09.330401 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:09.330862 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:09.331290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:09.362241 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-61d90147-5306-4ec4-9b16-0cb447318741 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047208 Oct 05 14:20:09.362805 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 446/865] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:20:09 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:20:09.426855 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:09.427451 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:09.433489 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:09.433976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:09.434417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:09.435104 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:09.435564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:09.435991 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:09.463879 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:20:09.560838 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-bfdb016f-abca-4426-b60a-8665ed0ea9ac tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 204 len: 0 microversion: 2.1 time: 0.138736 Oct 05 14:20:09.561491 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 420/866] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:20:09 2022] DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:20:09.570205 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:09.570921 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:09.580021 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:09.580824 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:09.581679 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:09.582626 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:09.583261 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:09.583713 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:09.602918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=100 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:09.811279 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:09.821469 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7279778b-0fcc-4b10-bcc1-b463b7ca5da1 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1673 microversion: 2.1 time: 0.254893 Oct 05 14:20:09.822284 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 447/867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:09 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:10.846384 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:10.847035 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:10.853524 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:10.854011 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:10.854445 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:10.855132 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:10.855584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:10.856005 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:10.988162 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:10.996730 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3f51e6ba-3504-486d-a47e-d56780f27c0f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1673 microversion: 2.1 time: 0.154620 Oct 05 14:20:10.997807 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 421/868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:10 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:12.020729 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:12.022265 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:12.032512 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:12.033007 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:12.037094 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:12.038711 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:12.039349 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:12.039944 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:12.197910 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:12.206073 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9271284a-3aab-4086-be69-d1a44a63405e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 200 len: 1673 microversion: 2.1 time: 0.189392 Oct 05 14:20:12.206636 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 448/869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:12 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:12.506996 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-dafe669f-98f7-46a4-a244-dc4d1b1de2c9 req-978216af-9186-4c8f-9a75-392b7541a4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412dd90-2b82-4914-a28f-cc8af68472e6", "name": "network-vif-deleted", "tag": "3c004758-1b5c-43fc-8097-9b75e38b9e20"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:12.525061 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-dafe669f-98f7-46a4-a244-dc4d1b1de2c9 req-978216af-9186-4c8f-9a75-392b7541a4bc service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:12.525862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-dafe669f-98f7-46a4-a244-dc4d1b1de2c9 req-978216af-9186-4c8f-9a75-392b7541a4bc service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:12.526531 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-dafe669f-98f7-46a4-a244-dc4d1b1de2c9 req-978216af-9186-4c8f-9a75-392b7541a4bc service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:12.539526 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-dafe669f-98f7-46a4-a244-dc4d1b1de2c9 req-978216af-9186-4c8f-9a75-392b7541a4bc service nova] Creating event network-vif-deleted:3c004758-1b5c-43fc-8097-9b75e38b9e20 for instance 0412dd90-2b82-4914-a28f-cc8af68472e6 on hv-cinder-83587 Oct 05 14:20:12.550773 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-dafe669f-98f7-46a4-a244-dc4d1b1de2c9 req-978216af-9186-4c8f-9a75-392b7541a4bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046327 Oct 05 14:20:12.559833 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 422/870] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:13.230986 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:13.231697 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:13.238926 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:13.239504 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:13.240002 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:13.240757 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:13.241306 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:13.241794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:13.256985 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] HTTP exception thrown: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Request method failure captured: Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 HTTP/1.1 Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZH34jrVu7h3skINhhpLwQpapHZWliDI-p1lIv_muWuRg6X284T4XpZqZLgk2TaCrJBWsf_pvg8tfwpfBZUcWnXjzMFeMeHhaeFS9clMpchgbphdYQuSDNHD2fyBifSvQrQKjv8-SXBJMikpFEsEflAUfVnQe7JrRVf1NN5vcLdsXxM Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:20:13.258773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e782ea111b44143a77f16c4846bb5e3"}]}] Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: d0245460724a442292f738e7e947c87b Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:20:13.260465 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '0412dd90-2b82-4914-a28f-cc8af68472e6'} Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:20:13.261481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:20:13.262948 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:20:13.264352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Returning 404 to user: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:20:13.264352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-20e46114-a92b-47fe-a9b3-57c67b47a21e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 404 len: 111 microversion: 2.1 time: 0.033493 Oct 05 14:20:13.264352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 449/871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:13 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:20:13.270722 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-7dc8b454-dd9b-4b86-b9e6-7d98e89562a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '.version_select at 0x7f218d09daf0>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:13.289463 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-7dc8b454-dd9b-4b86-b9e6-7d98e89562a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998890400" status: 202 len: 0 microversion: 2.1 time: 0.023120 Oct 05 14:20:13.290034 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 423/872] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 14:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998890400 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:20:14.138319 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f38849a4-8470-4396-a40f-f12903cc163e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: .version_select at 0x7f218d0ade50>, body: {"keypair": {"name": "tempest-keypair-308648817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuIjN31khcZbdliIE/kPkCKu4hLBSHcLKtQOoKCs0DI4Ynu/VkV7+TbSC3B+GdHHL0DWy/ehU4WM2KRgG1GCd1JpvFP2Z8ytKVPOvYDK/CI5utfog5L4k5sNg7V+4reYg=="}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:14.144116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:14.156983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-f38849a4-8470-4396-a40f-f12903cc163e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:20:14.160769 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.quota [None req-f38849a4-8470-4396-a40f-f12903cc163e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for user d0245460724a442292f738e7e947c87b and project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'key_pairs'} {{(pid=120645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:20:14.189599 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f38849a4-8470-4396-a40f-f12903cc163e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055041 Oct 05 14:20:14.190203 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 450/873] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 14:20:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:15.441998 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-62985211", "imageRef": "2429c2b3-2b3f-4221-bf23-6ffc7a12d290", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9efe8cc8-cefb-4fdc-a174-ba54f8a177b3"}], "security_groups": [{"name": "tempest-securitygroup--1472175850"}], "key_name": "tempest-keypair-308648817", "user_data": "}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:15.450775 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:15.546417 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.network.neutron [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] validate_networks() for [('9efe8cc8-cefb-4fdc-a174-ba54f8a177b3', None, None, None, None, None)] {{(pid=120646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 14:20:15.905096 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Flavor limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 14:20:15.905556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Image limits 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 14:20:15.906692 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Flavor pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 14:20:15.907109 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Image pref 0:0:0 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 14:20:15.907527 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.virt.hardware [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 14:20:15.916127 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:15.916608 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:15.917044 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:15.917813 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:15.918271 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:15.918700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:15.934826 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 14:20:15.938656 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.quota [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Getting quotas for user d0245460724a442292f738e7e947c87b and project 0e782ea111b44143a77f16c4846bb5e3. Resources: {'instances', 'cores', 'ram'} {{(pid=120646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 14:20:15.949163 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Going to run 1 instances... {{(pid=120646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 14:20:15.951540 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2429c2b3-2b3f-4221-bf23-6ffc7a12d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 14:20:15.998601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-5bf6239d-eaf5-4a7f-98c6-975bfb60e42a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561359 Oct 05 14:20:15.999241 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 424/874] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 14:20:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 14:20:16.010943 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-6837de56-3ae3-44b0-a38e-e6d34b1ef56a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:16.011720 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-6837de56-3ae3-44b0-a38e-e6d34b1ef56a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:16.065840 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-6837de56-3ae3-44b0-a38e-e6d34b1ef56a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:16.072598 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-6837de56-3ae3-44b0-a38e-e6d34b1ef56a tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1235 microversion: 2.1 time: 0.065618 Oct 05 14:20:16.073269 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 451/875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:16 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:17.096335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:17.096959 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:17.104016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:17.104517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:17.105335 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:17.105701 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:17.106156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:17.106591 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:17.179165 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:17.186790 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-f21e1e97-26ca-4931-8454-d4fb776e656e tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1293 microversion: 2.1 time: 0.095456 Oct 05 14:20:17.187379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 425/876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:17 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:18.209983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:18.210594 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:18.217054 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:18.217781 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:18.218029 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:18.219353 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:18.219809 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:18.220236 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:18.347726 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:18.355234 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-59cc88ba-9b18-46c8-b0d9-da90b244767c tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1361 microversion: 2.1 time: 0.149127 Oct 05 14:20:18.355794 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 452/877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:18 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:18.402339 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-783efed8-8537-4d38-bbab-9fa31844f995 req-4a9b2931-c1eb-417b-a3f5-baa22649dada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a06867-be9e-47c9-9bc9-9066cc9eaae0", "tag": "2493c969-0543-4d76-82ea-7b4052ffbc43"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:18.414844 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-783efed8-8537-4d38-bbab-9fa31844f995 req-4a9b2931-c1eb-417b-a3f5-baa22649dada service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:18.415575 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-783efed8-8537-4d38-bbab-9fa31844f995 req-4a9b2931-c1eb-417b-a3f5-baa22649dada service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:18.415790 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-783efed8-8537-4d38-bbab-9fa31844f995 req-4a9b2931-c1eb-417b-a3f5-baa22649dada service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:18.428356 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-783efed8-8537-4d38-bbab-9fa31844f995 req-4a9b2931-c1eb-417b-a3f5-baa22649dada service nova] Creating event network-changed:2493c969-0543-4d76-82ea-7b4052ffbc43 for instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 on hv-cinder-83587 Oct 05 14:20:18.433058 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-783efed8-8537-4d38-bbab-9fa31844f995 req-4a9b2931-c1eb-417b-a3f5-baa22649dada service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Oct 05 14:20:18.433696 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 426/878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:19.380039 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:19.380647 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:19.387060 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:19.387538 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:19.387975 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:19.388654 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:19.389108 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:19.389561 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:19.521847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:19.529419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8935f704-d149-46cf-9ca1-eb588b170eee tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1361 microversion: 2.1 time: 0.153157 Oct 05 14:20:19.529986 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 453/879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:19 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:20.553338 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:20.554045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:20.560124 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:20.560607 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:20.561045 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:20.561763 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:20.562752 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:20.563182 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:20.950264 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:20.958420 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4678a39d-4f78-4717-9b96-15469f9d65e0 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1361 microversion: 2.1 time: 0.409858 Oct 05 14:20:20.958976 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 427/880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:20 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 14:20:21.980546 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:21.981154 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:21.987816 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:21.988295 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:21.988728 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:21.989452 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:21.989902 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:21.990326 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:22.117797 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:22.125907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-9ceaa03a-3ca1-4715-b701-40ec14ac09a2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1361 microversion: 2.1 time: 0.149141 Oct 05 14:20:22.126459 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 454/881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:21 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:23.148936 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:23.149496 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:23.155858 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:23.156368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:23.156804 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:23.157519 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:23.157970 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:23.158392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:23.288121 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:23.295650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-4841b995-772f-4e00-81cd-4fa234fc4282 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1361 microversion: 2.1 time: 0.150698 Oct 05 14:20:23.296222 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 428/882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:23 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:23.591116 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-a13f3cf7-90ad-4dcb-b43e-2c9f503b7625 req-9609c724-049c-4ff5-8c0c-8ca57932ab22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a06867-be9e-47c9-9bc9-9066cc9eaae0", "name": "network-vif-plugged", "status": "completed", "tag": "2493c969-0543-4d76-82ea-7b4052ffbc43"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:23.601732 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a13f3cf7-90ad-4dcb-b43e-2c9f503b7625 req-9609c724-049c-4ff5-8c0c-8ca57932ab22 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:23.602210 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a13f3cf7-90ad-4dcb-b43e-2c9f503b7625 req-9609c724-049c-4ff5-8c0c-8ca57932ab22 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:23.602859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-a13f3cf7-90ad-4dcb-b43e-2c9f503b7625 req-9609c724-049c-4ff5-8c0c-8ca57932ab22 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:23.614825 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-a13f3cf7-90ad-4dcb-b43e-2c9f503b7625 req-9609c724-049c-4ff5-8c0c-8ca57932ab22 service nova] Creating event network-vif-plugged:2493c969-0543-4d76-82ea-7b4052ffbc43 for instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 on hv-cinder-83587 Oct 05 14:20:23.619771 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-a13f3cf7-90ad-4dcb-b43e-2c9f503b7625 req-9609c724-049c-4ff5-8c0c-8ca57932ab22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032518 Oct 05 14:20:23.620357 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 455/883] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:24.318556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:24.319174 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:24.325624 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:24.326117 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:24.326559 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:24.327254 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:24.328391 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:24.328824 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:24.452247 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:24.457432 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:24.463908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c457cce7-75ba-4331-b6bb-b930bb43e1e4 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1361 microversion: 2.1 time: 0.149265 Oct 05 14:20:24.464479 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 429/884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:24 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:25.487850 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:25.488542 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:25.494691 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:25.495174 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:25.495609 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:25.496293 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:25.496750 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:25.497176 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:25.630423 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:20:25.638078 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-5e732503-4ec4-492c-86ff-eef743e55593 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1547 microversion: 2.1 time: 0.155665 Oct 05 14:20:25.638629 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 456/885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:20:25 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:20:25.662120 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:20:25.662639 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:20:25.670514 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:25.671578 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:25.672020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:25.672724 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:25.673185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:25.673643 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:25.756287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-68aaf164-77eb-42e8-b637-1282b6455945 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097909 Oct 05 14:20:25.756889 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 430/886] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 14:20:25 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:20:26.663879 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [req-e253dce2-65e7-4485-92fb-596f38c01a68 req-70c25386-ddb6-471d-9ab1-1d7f8469f3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a06867-be9e-47c9-9bc9-9066cc9eaae0", "tag": "2493c969-0543-4d76-82ea-7b4052ffbc43"}]} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:20:26.669103 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell0:SELECT=6 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:26.675936 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e253dce2-65e7-4485-92fb-596f38c01a68 req-70c25386-ddb6-471d-9ab1-1d7f8469f3a7 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:20:26.676509 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e253dce2-65e7-4485-92fb-596f38c01a68 req-70c25386-ddb6-471d-9ab1-1d7f8469f3a7 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:20:26.677011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [req-e253dce2-65e7-4485-92fb-596f38c01a68 req-70c25386-ddb6-471d-9ab1-1d7f8469f3a7 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:20:26.687953 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.compute.server_external_events [req-e253dce2-65e7-4485-92fb-596f38c01a68 req-70c25386-ddb6-471d-9ab1-1d7f8469f3a7 service nova] Creating event network-changed:2493c969-0543-4d76-82ea-7b4052ffbc43 for instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 on hv-cinder-83587 Oct 05 14:20:26.693180 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [req-e253dce2-65e7-4485-92fb-596f38c01a68 req-70c25386-ddb6-471d-9ab1-1d7f8469f3a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032949 Oct 05 14:20:26.693806 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 457/887] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:02.877996 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=2 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:02.879033 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell0:SELECT=6 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:02.880310 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:02.880942 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG dbcounter [-] [120646] Writing DB stats nova_cell1:SELECT=4 {{(pid=120646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:02.885483 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:02.886007 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:02.895115 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:02.895601 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:02.896041 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:02.896730 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:02.897191 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:02.897648 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:02.920677 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-39cc0d72-b877-417b-8dc3-3cf1481aff59 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/ips" status: 200 len: 145 microversion: 2.1 time: 0.043396 Oct 05 14:21:02.921253 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 431/888] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:21:02 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:04.243937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:04.244730 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG dbcounter [-] [120645] Writing DB stats nova_cell1:SELECT=39 {{(pid=120645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:04.249505 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9fd1265-7e5e-4d69-8273-a2525bac6bfc"}} {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:21:04.252399 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:04.259727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:04.260212 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:04.260651 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:04.261381 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:04.261844 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:04.262272 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:04.495962 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-7609e551-d5b6-4ea4-8821-09dac841c296 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253357 Oct 05 14:21:04.496560 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 458/889] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:21:04 2022] POST /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:05.682185 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:05.684303 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:05.690893 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:05.691378 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:05.691818 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:05.692505 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:05.692955 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:05.693412 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:05.725630 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-0726ecb5-0ca9-42fd-8b53-7257d71238eb tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047269 Oct 05 14:21:05.726345 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 432/890] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:21:05 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:05.738071 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:05.738691 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:05.745366 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:05.745853 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:05.746293 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:05.746983 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:05.747446 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:05.747876 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:05.777379 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-f0b9a39c-b48e-45d5-bad5-d11db3b39ecf tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/a9fd1265-7e5e-4d69-8273-a2525bac6bfc" status: 200 len: 194 microversion: 2.1 time: 0.043765 Oct 05 14:21:05.778011 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 459/891] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 5 14:21:05 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/a9fd1265-7e5e-4d69-8273-a2525bac6bfc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 14:21:07.102667 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19f11640-8448-45a5-b0ac-3dc4bbecb739"}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:21:07.104982 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:07.111645 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:07.112133 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:07.112571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:07.113287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:07.113747 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:07.114174 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:07.347071 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-99621cd9-adca-44a3-a5ae-d48ebd5de967 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "POST /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248234 Oct 05 14:21:07.347662 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 433/892] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 14:21:07 2022] POST /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:09.603838 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:09.606102 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:09.612617 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:09.613101 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:09.613572 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:09.614256 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:09.614708 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:09.615132 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:09.644376 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-80fc1fa3-eba4-4825-9aed-6859215fbd04 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044435 Oct 05 14:21:09.644991 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 460/893] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:21:09 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:09.792631 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:09.793250 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:09.799529 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:09.800020 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:09.800462 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:09.801157 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:09.801654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:09.802087 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:09.830672 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-08ea8478-c9cb-4a4a-adb3-e6ed21b35529 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/a9fd1265-7e5e-4d69-8273-a2525bac6bfc" status: 200 len: 194 microversion: 2.1 time: 0.042828 Oct 05 14:21:09.831251 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 434/894] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 5 14:21:09 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/a9fd1265-7e5e-4d69-8273-a2525bac6bfc => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:09.841803 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:09.842329 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:09.848801 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:09.849327 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:09.849770 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:09.850458 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:09.850918 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:09.851343 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:09.930740 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lazy-loading 'services' on Instance uuid 19a06867-be9e-47c9-9bc9-9066cc9eaae0 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:21:10.004522 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c4a3dc94-d24e-4a1b-83f3-b5e26ae9c605 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/a9fd1265-7e5e-4d69-8273-a2525bac6bfc" status: 202 len: 0 microversion: 2.1 time: 0.166463 Oct 05 14:21:10.005152 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 461/895] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:21:09 2022] DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/a9fd1265-7e5e-4d69-8273-a2525bac6bfc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:21:11.128577 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:11.129067 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:11.135368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:11.135849 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:11.136286 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:11.136966 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:11.137455 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:11.137882 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:11.165650 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-08b7d68b-c879-4e8a-bb5f-65e7680e4655 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/19f11640-8448-45a5-b0ac-3dc4bbecb739" status: 200 len: 194 microversion: 2.1 time: 0.041533 Oct 05 14:21:11.166211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 435/896] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 5 14:21:11 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/19f11640-8448-45a5-b0ac-3dc4bbecb739 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:11.178053 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:11.179091 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:11.185161 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:11.185715 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:11.186155 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:11.186845 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:11.187302 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:11.187727 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:11.269479 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.objects.instance [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lazy-loading 'services' on Instance uuid 19a06867-be9e-47c9-9bc9-9066cc9eaae0 {{(pid=120645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 14:21:11.337245 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-e8a676b1-f794-470d-9b55-0b709bb04672 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/19f11640-8448-45a5-b0ac-3dc4bbecb739" status: 202 len: 0 microversion: 2.1 time: 0.164228 Oct 05 14:21:11.337848 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 462/897] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 14:21:11 2022] DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments/19f11640-8448-45a5-b0ac-3dc4bbecb739 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:21:12.506457 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:12.508702 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:12.514982 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.515470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.515908 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.516593 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.517049 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.517505 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.545861 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-d79c7671-ed12-4991-afe6-c4570e920743 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043847 Oct 05 14:21:12.546397 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 436/898] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:21:12 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:21:12.665287 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:12.667643 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:12.673866 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.674905 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.675418 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.676119 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.676575 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.676999 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.705127 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-3814788e-a784-4ca4-8258-3fefbed18cfd tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044689 Oct 05 14:21:12.705756 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 463/899] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 14:21:12 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 14:21:12.770159 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:12.770810 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:12.776685 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.777178 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.777654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.778352 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.778814 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.779245 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.804586 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Going to try to terminate instance {{(pid=120646) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:21:12.879156 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-faed6500-ec61-4a56-a0ca-8944328cb6b3 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 204 len: 0 microversion: 2.1 time: 0.112608 Oct 05 14:21:12.879971 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 437/900] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:21:12 2022] DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:21:12.887833 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:12.888442 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:12.894315 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.894795 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.895235 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:12.895933 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:12.896371 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:12.896799 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:13.027352 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:21:13.035580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bf031f33-82ee-4aa8-868c-617dbada4be2 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1671 microversion: 2.1 time: 0.151577 Oct 05 14:21:13.036145 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 464/901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:12 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:21:14.059674 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:14.060312 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:14.067452 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:14.067940 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:14.068382 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:14.069079 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:14.069570 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:14.070001 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:14.204269 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:21:14.212016 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-c070b7ad-a481-4833-ac33-753483e0dc47 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1671 microversion: 2.1 time: 0.156635 Oct 05 14:21:14.212584 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 438/902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:14 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:21:15.235365 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:15.235982 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:15.243907 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:15.244481 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:15.244917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:15.245635 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:15.246085 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:15.246507 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:15.340438 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0245460724a442292f738e7e947c87b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e782ea111b44143a77f16c4846bb5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:21:15.348204 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bba66262-c1c7-4c15-8bd1-739904850b2b tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 200 len: 1603 microversion: 2.1 time: 0.116975 Oct 05 14:21:15.348766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 465/903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:15 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 1603 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:21:15.523181 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-51b3c695-06c3-465d-903e-e13567420600 req-4fff38a3-ec58-47bc-bbfb-8cb92d48a7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a06867-be9e-47c9-9bc9-9066cc9eaae0", "name": "network-vif-deleted", "tag": "2493c969-0543-4d76-82ea-7b4052ffbc43"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:21:15.545547 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-51b3c695-06c3-465d-903e-e13567420600 req-4fff38a3-ec58-47bc-bbfb-8cb92d48a7b6 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:15.546030 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-51b3c695-06c3-465d-903e-e13567420600 req-4fff38a3-ec58-47bc-bbfb-8cb92d48a7b6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:15.546453 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-51b3c695-06c3-465d-903e-e13567420600 req-4fff38a3-ec58-47bc-bbfb-8cb92d48a7b6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:15.571373 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-51b3c695-06c3-465d-903e-e13567420600 req-4fff38a3-ec58-47bc-bbfb-8cb92d48a7b6 service nova] Creating event network-vif-deleted:2493c969-0543-4d76-82ea-7b4052ffbc43 for instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 on hv-cinder-83587 Oct 05 14:21:15.577984 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-51b3c695-06c3-465d-903e-e13567420600 req-4fff38a3-ec58-47bc-bbfb-8cb92d48a7b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059833 Oct 05 14:21:15.579198 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 439/904] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:16.371870 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:16.372482 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:16.378859 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:16.379339 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:16.379773 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:16.380454 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:16.380906 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:16.381419 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:16.394994 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] HTTP exception thrown: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Request method failure captured: Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 HTTP/1.1 Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZH34jrVu7h3skINhhpLwQpapHZWliDI-p1lIv_muWuRg6X284T4XpZqZLgk2TaCrJBWsf_pvg8tfwpfBZUcWnXjzMFeMeHhaeFS9clMpchgbphdYQuSDNHD2fyBifSvQrQKjv8-SXBJMikpFEsEflAUfVnQe7JrRVf1NN5vcLdsXxM Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:21:16.396634 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e782ea111b44143a77f16c4846bb5e3"}]}] Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: d0245460724a442292f738e7e947c87b Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:16.398439 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '19a06867-be9e-47c9-9bc9-9066cc9eaae0'} Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:16.399336 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:16.400917 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:16.402279 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Returning 404 to user: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:16.402279 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-0ad0567f-62e8-474e-9ee7-8dacad64469f tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 404 len: 111 microversion: 2.1 time: 0.030032 Oct 05 14:21:16.402279 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 466/905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:16 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:21:16.407470 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8e924855-cac9-46cd-8739-4762a7585bc9 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '.version_select at 0x7f218cf6d430>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:16.430944 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8e924855-cac9-46cd-8739-4762a7585bc9 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-308648817" status: 202 len: 0 microversion: 2.1 time: 0.027529 Oct 05 14:21:16.431530 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 440/906] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 14:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-308648817 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 14:21:17.807082 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:17.807607 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:17.809482 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-e0d3deca-6a37-4baf-a556-553f47e6223b req-1b1a72cf-966c-40b1-a751-dd11e0c007a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:21:17.813974 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:17.814707 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:17.815758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:17.816569 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:17.817022 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:17.817471 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:17.821164 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e0d3deca-6a37-4baf-a556-553f47e6223b req-1b1a72cf-966c-40b1-a751-dd11e0c007a6 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:17.821945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e0d3deca-6a37-4baf-a556-553f47e6223b req-1b1a72cf-966c-40b1-a751-dd11e0c007a6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:17.822484 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-e0d3deca-6a37-4baf-a556-553f47e6223b req-1b1a72cf-966c-40b1-a751-dd11e0c007a6 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:17.834437 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-e0d3deca-6a37-4baf-a556-553f47e6223b req-1b1a72cf-966c-40b1-a751-dd11e0c007a6 service nova] Creating event network-changed:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:21:17.840166 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-e0d3deca-6a37-4baf-a556-553f47e6223b req-1b1a72cf-966c-40b1-a751-dd11e0c007a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035204 Oct 05 14:21:17.841294 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 441/907] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:17.845532 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Going to try to terminate instance {{(pid=120645) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 14:21:17.944534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-bc1a0807-cf29-4cce-868b-9b67b16a0d6b tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 204 len: 0 microversion: 2.1 time: 0.137818 Oct 05 14:21:17.945257 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 467/908] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:21:17 2022] DELETE /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 14:21:17.953884 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:17.954589 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:17.961272 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:17.961771 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:17.962211 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:17.962909 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:17.963368 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:17.963799 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:18.297472 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.policy [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120646) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:21:18.305992 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-fc13f292-3115-42c5-af4f-a4b7c9ec41f8 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.356293 Oct 05 14:21:18.306564 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 442/909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:17 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:21:19.328448 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:19.329153 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:19.335990 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.336473 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.336908 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.337630 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.338076 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.338696 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.532945 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:19.533556 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:19.536975 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.policy [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1ece6236d04eddbb87c7e43f3f7e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301ae8617218468c977da95e02cb75ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120645) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 14:21:19.542003 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.542571 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.543199 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.543958 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.544423 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.544834 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-51118ed2-c60a-49b2-bda6-d24fd64df04f tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 200 len: 1566 microversion: 2.1 time: 0.220583 Oct 05 14:21:19.544985 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.545424 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 468/910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:19 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 14:21:19.561093 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] HTTP exception thrown: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Request method failure captured: Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 HTTP/1.1 Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZH34jrVu7h3skINhhpLwQpapHZWliDI-p1lIv_muWuRg6X284T4XpZqZLgk2TaCrJBWsf_pvg8tfwpfBZUcWnXjzMFeMeHhaeFS9clMpchgbphdYQuSDNHD2fyBifSvQrQKjv8-SXBJMikpFEsEflAUfVnQe7JrRVf1NN5vcLdsXxM Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:21:19.562823 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e782ea111b44143a77f16c4846bb5e3"}]}] Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: d0245460724a442292f738e7e947c87b Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.564392 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '19a06867-be9e-47c9-9bc9-9066cc9eaae0'} Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:19.565319 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.566795 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.568517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Returning 404 to user: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:19.568517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-2bd2a0e5-fef4-4d54-bd21-880fd2c78b43 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 404 len: 111 microversion: 2.1 time: 0.035426 Oct 05 14:21:19.568517 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 443/911] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:21:19 2022] DELETE /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 14:21:19.573758 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:19.574412 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 19a06867-be9e-47c9-9bc9-9066cc9eaae0] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:19.580638 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.581898 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.582350 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.583127 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.583861 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.584580 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.599807 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] HTTP exception thrown: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Request method failure captured: Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 HTTP/1.1 Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZH34jrVu7h3skINhhpLwQpapHZWliDI-p1lIv_muWuRg6X284T4XpZqZLgk2TaCrJBWsf_pvg8tfwpfBZUcWnXjzMFeMeHhaeFS9clMpchgbphdYQuSDNHD2fyBifSvQrQKjv8-SXBJMikpFEsEflAUfVnQe7JrRVf1NN5vcLdsXxM Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:21:19.601534 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e782ea111b44143a77f16c4846bb5e3"}]}] Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: d0245460724a442292f738e7e947c87b Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.603222 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '19a06867-be9e-47c9-9bc9-9066cc9eaae0'} Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:19.604168 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. Oct 05 14:21:19.605677 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:19.607062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Returning 404 to user: Instance 19a06867-be9e-47c9-9bc9-9066cc9eaae0 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:19.607062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-c355095f-19b7-4baa-a928-5b85e3ce357d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0" status: 404 len: 111 microversion: 2.1 time: 0.033044 Oct 05 14:21:19.607062 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 469/912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:19 2022] GET /compute/v2.1/servers/19a06867-be9e-47c9-9bc9-9066cc9eaae0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:21:19.857005 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [req-d0c35af9-3f61-4120-879b-e7557dd0547d req-f35a2e10-1880-438f-bd8e-1348d8a17990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce46222-85a1-40c3-bebc-103c7c71b7f4", "name": "network-vif-deleted", "tag": "fc4dd38e-8c84-48f8-811d-3b610a4fb542"}]} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:21:19.867024 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d0c35af9-3f61-4120-879b-e7557dd0547d req-f35a2e10-1880-438f-bd8e-1348d8a17990 service nova] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:19.867511 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d0c35af9-3f61-4120-879b-e7557dd0547d req-f35a2e10-1880-438f-bd8e-1348d8a17990 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:19.867943 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [req-d0c35af9-3f61-4120-879b-e7557dd0547d req-f35a2e10-1880-438f-bd8e-1348d8a17990 service nova] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:19.879344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.compute.server_external_events [req-d0c35af9-3f61-4120-879b-e7557dd0547d req-f35a2e10-1880-438f-bd8e-1348d8a17990 service nova] Creating event network-vif-deleted:fc4dd38e-8c84-48f8-811d-3b610a4fb542 for instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 on hv-cinder-83587 Oct 05 14:21:19.884344 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [req-d0c35af9-3f61-4120-879b-e7557dd0547d req-f35a2e10-1880-438f-bd8e-1348d8a17990 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030953 Oct 05 14:21:19.884911 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 444/913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 14:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:20.568135 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:20.568700 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] [instance: 0ce46222-85a1-40c3-bebc-103c7c71b7f4] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:20.575292 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:20.575768 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:20.576199 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:20.576883 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:20.577545 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:20.577964 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:20.591614 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] HTTP exception thrown: Instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 could not be found. Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Request method failure captured: Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 HTTP/1.1 Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZHiAhKeZgcVrBLuUBvV8bWynTc25dHU11PeMfMZQqlkbtBAwyiWGdtCoUPJntaizbvBcOKgnNOFzitmPpKMg9ZMHSeJWodf4458K7MgQtHt6yYSflY7F71xLQM8FuJ0obR2vWw460VeGVutY-dMMMAY9ex6mxFIjAM6aKtx5U7bkVU Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 301ae8617218468c977da95e02cb75ee Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-TestShelveInstance-1566651287 Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:21:20.593131 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/301ae8617218468c977da95e02cb75ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/301ae8617218468c977da95e02cb75ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/301ae8617218468c977da95e02cb75ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_301ae8617218468c977da95e02cb75ee"}]}] Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-TestShelveInstance-1566651287 Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 301ae8617218468c977da95e02cb75ee Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-TestShelveInstance-1566651287 Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-TestShelveInstance-1566651287-project Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: db1ece6236d04eddbb87c7e43f3f7e42 Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-TestShelveInstance-1566651287-project Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 could not be found. Oct 05 14:21:20.594766 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '0ce46222-85a1-40c3-bebc-103c7c71b7f4'} Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 could not be found. Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:20.595741 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 could not be found. Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 could not be found. Oct 05 14:21:20.597847 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.599192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Returning 404 to user: Instance 0ce46222-85a1-40c3-bebc-103c7c71b7f4 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:20.599192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-75ee8d38-9850-4fd0-aa1d-429a848ce530 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4" status: 404 len: 111 microversion: 2.1 time: 0.030420 Oct 05 14:21:20.599192 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 470/914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:20 2022] GET /compute/v2.1/servers/0ce46222-85a1-40c3-bebc-103c7c71b7f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:21:20.757687 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:20.758287 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.compute.api [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120646) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:20.765937 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-470421b3-c1d8-479f-8840-c1abb9bc32f5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] Calling method '.version_select at 0x7f218d0f0310>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:20.771956 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:20.772862 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:20.773372 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:20.774145 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:20.774611 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:20.775192 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG oslo_concurrency.lockutils [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:20.790645 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-470421b3-c1d8-479f-8840-c1abb9bc32f5 tempest-TestShelveInstance-1566651287 tempest-TestShelveInstance-1566651287-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-477654794" status: 202 len: 0 microversion: 2.1 time: 0.028495 Oct 05 14:21:20.791592 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] HTTP exception thrown: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.792332 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 471/915] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 14:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-477654794 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Request method failure captured: Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 HTTP/1.1 Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZH34jrVu7h3skINhhpLwQpapHZWliDI-p1lIv_muWuRg6X284T4XpZqZLgk2TaCrJBWsf_pvg8tfwpfBZUcWnXjzMFeMeHhaeFS9clMpchgbphdYQuSDNHD2fyBifSvQrQKjv8-SXBJMikpFEsEflAUfVnQe7JrRVf1NN5vcLdsXxM Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:21:20.793890 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e782ea111b44143a77f16c4846bb5e3"}]}] Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: d0245460724a442292f738e7e947c87b Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: > Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.795686 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '0412dd90-2b82-4914-a28f-cc8af68472e6'} Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:20.796709 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.797953 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.799175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Returning 404 to user: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:20.799175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-3bcf16e4-2a78-49b5-baf5-8413f1a02380 tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 404 len: 111 microversion: 2.1 time: 0.042982 Oct 05 14:21:20.799175 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 445/916] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 14:21:20 2022] DELETE /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:21:20.805869 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Calling method '>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:20.806494 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.compute.api [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] [instance: 0412dd90-2b82-4914-a28f-cc8af68472e6] Fetching instance by UUID {{(pid=120645) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 14:21:20.813675 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:20.814161 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:20.814612 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:20.815398 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Acquiring lock "ab08cad5-af0f-42a8-b6cc-999af6152333" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 14:21:20.815857 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 14:21:20.816290 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG oslo_concurrency.lockutils [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Lock "ab08cad5-af0f-42a8-b6cc-999af6152333" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 14:21:20.830019 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.wsgi [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] HTTP exception thrown: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Request method failure captured: Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: request: GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 HTTP/1.1 Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept: application/json Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Accept-Encoding: identity Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Connection: close Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Length: 0 Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Content-Type: application/json Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Host: 10.222.0.16 Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: Openstack-System-Scope: None Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Auth-Token: gAAAAABjPZH34jrVu7h3skINhhpLwQpapHZWliDI-p1lIv_muWuRg6X284T4XpZqZLgk2TaCrJBWsf_pvg8tfwpfBZUcWnXjzMFeMeHhaeFS9clMpchgbphdYQuSDNHD2fyBifSvQrQKjv8-SXBJMikpFEsEflAUfVnQe7JrRVf1NN5vcLdsXxM Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Id: None Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Domain-Name: None Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Identity-Status: Confirmed Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Is-Admin-Project: True Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Id: default Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Domain-Name: Default Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Project-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Role: member,reader Oct 05 14:21:20.832218 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Roles: member,reader Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e782ea111b44143a77f16c4846bb5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e782ea111b44143a77f16c4846bb5e3"}]}] Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Id: 0e782ea111b44143a77f16c4846bb5e3 Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-717002739 Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Id: default Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Domain-Name: Default Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Id: d0245460724a442292f738e7e947c87b Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: X-User-Name: tempest-AttachVolumeTestJSON-717002739-project Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: method: > Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: exception: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.833827 dv-cinder-835878-4-smb devstack@n-api.service[120645]: action_args: {'id': '0412dd90-2b82-4914-a28f-cc8af68472e6'} Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:20.834682 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. Oct 05 14:21:20.836109 dv-cinder-835878-4-smb devstack@n-api.service[120645]: ERROR nova.api.openstack.wsgi Oct 05 14:21:20.837441 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] Returning 404 to user: Instance 0412dd90-2b82-4914-a28f-cc8af68472e6 could not be found. {{(pid=120645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:20.837441 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-da8c04cf-0dc4-4ece-b412-4a71e9a68c6d tempest-AttachVolumeTestJSON-717002739 tempest-AttachVolumeTestJSON-717002739-project] 10.222.0.16 "GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6" status: 404 len: 111 microversion: 2.1 time: 0.032351 Oct 05 14:21:20.837441 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 472/917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 14:21:20 2022] GET /compute/v2.1/servers/0412dd90-2b82-4914-a28f-cc8af68472e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 14:21:25.808737 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-8e5a485a-fdf2-4603-8cb3-393a64126485 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Action: 'create', calling method: .version_select at 0x7f218d09d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-990294131", "metadata": {"Type": "work"}}} {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 14:21:26.172573 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-8e5a485a-fdf2-4603-8cb3-393a64126485 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.499028 Oct 05 14:21:26.173443 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 446/918] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 14:21:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 501 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 14:21:26.187776 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-31acf1a5-d413-47a7-a11c-7a52558c68f3 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Calling method '.version_select at 0x7f218d076310>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:26.243360 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-31acf1a5-d413-47a7-a11c-7a52558c68f3 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90" status: 200 len: 352 microversion: 2.1 time: 0.059959 Oct 05 14:21:26.243931 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 473/919] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:21:26 2022] GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:27.259654 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-9030f4a6-a875-4d4e-98da-66c6381708b1 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Calling method '.version_select at 0x7f218d142b80>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:27.318633 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-9030f4a6-a875-4d4e-98da-66c6381708b1 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90" status: 200 len: 353 microversion: 2.1 time: 0.063802 Oct 05 14:21:27.319614 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 447/920] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:21:27 2022] GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:27.332583 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-8fa3d2a4-e67a-4125-abf4-f247ade56c17 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Calling method '.version_select at 0x7f218d048790>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:27.386232 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-8fa3d2a4-e67a-4125-abf4-f247ade56c17 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90" status: 200 len: 353 microversion: 2.1 time: 0.057359 Oct 05 14:21:27.386954 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 474/921] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:21:27 2022] GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:27.406761 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-aa54969a-bbc0-443b-9094-bd3795e7eed9 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Calling method '.version_select at 0x7f218d0bc310>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:27.522379 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-aa54969a-bbc0-443b-9094-bd3795e7eed9 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90" status: 202 len: 0 microversion: 2.1 time: 0.119734 Oct 05 14:21:27.527317 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 448/922] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 14:21:27 2022] DELETE /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 14:21:27.534567 dv-cinder-835878-4-smb devstack@n-api.service[120645]: DEBUG nova.api.openstack.wsgi [None req-1942dc0f-81bc-489f-9b69-ee1bfa56bc64 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Calling method '.version_select at 0x7f218d0f05e0>' {{(pid=120645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:27.585322 dv-cinder-835878-4-smb devstack@n-api.service[120645]: INFO nova.api.openstack.requestlog [None req-1942dc0f-81bc-489f-9b69-ee1bfa56bc64 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90" status: 200 len: 352 microversion: 2.1 time: 0.055809 Oct 05 14:21:27.586123 dv-cinder-835878-4-smb devstack@n-api.service[120645]: [pid: 120645|app: 0|req: 475/923] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:21:27 2022] GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 14:21:28.600644 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ccf64e31-900f-4757-8413-bf4c9b2211f2 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Calling method '.version_select at 0x7f218d1c9670>' {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 14:21:28.630840 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.wsgi [None req-ccf64e31-900f-4757-8413-bf4c9b2211f2 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] HTTP exception thrown: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ccf64e31-900f-4757-8413-bf4c9b2211f2 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Request method failure captured: Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: request: GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 HTTP/1.1 Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept: application/json Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Accept-Encoding: identity Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Connection: close Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Length: 0 Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Content-Type: application/json Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Host: 10.222.0.16 Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: Openstack-System-Scope: None Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: User-Agent: python-urllib3/1.26.12 Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Auth-Token: gAAAAABjPZLl7_oofZhWsWdLQHph49Xe6BMcabh1AbbU4BDnpFtFHFfi27BNJYFXj0EkVGBJeqWZtz3AEBNZBrDEt7LY_Z7S9cIh5kVFoYoxGS_vIXD8402kBjSdfyGE1KSXbS2YWDySchXIoQR0GHwz06Co-WrCpnEDrPHpcawFFptMUbizqTo Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Id: None Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Domain-Name: None Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Identity-Status: Confirmed Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Is-Admin-Project: True Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Id: default Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Domain-Name: Default Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Id: e7cac69cec144c8c8625d2f89ce8237a Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Project-Name: tempest-VolumesGetTestJSON-505601620 Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Role: member,reader Oct 05 14:21:28.632851 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Roles: member,reader Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cac69cec144c8c8625d2f89ce8237a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7cac69cec144c8c8625d2f89ce8237a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cac69cec144c8c8625d2f89ce8237a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7cac69cec144c8c8625d2f89ce8237a"}]}] Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant: tempest-VolumesGetTestJSON-505601620 Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Id: e7cac69cec144c8c8625d2f89ce8237a Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-Tenant-Name: tempest-VolumesGetTestJSON-505601620 Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User: tempest-VolumesGetTestJSON-505601620-project Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Id: default Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Domain-Name: Default Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Id: 3a7b1d8d3e414781a4b0ac40b0f93f8b Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: X-User-Name: tempest-VolumesGetTestJSON-505601620-project Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: method: Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: exception: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: action_args: {'id': '1849b39b-2e09-4c2c-a90f-474d6d31ec90'} Oct 05 14:21:28.634528 dv-cinder-835878-4-smb devstack@n-api.service[120646]: {{(pid=120646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. (HTTP 404) (Request-ID: req-6d91b5a8-be10-44c6-9231-3d610512a8e2) Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:28.635700 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 14:21:28.636927 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 14:21:28.639147 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: ERROR nova.api.openstack.wsgi Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: DEBUG nova.api.openstack.wsgi [None req-ccf64e31-900f-4757-8413-bf4c9b2211f2 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] Returning 404 to user: Volume 1849b39b-2e09-4c2c-a90f-474d6d31ec90 could not be found. {{(pid=120646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: INFO nova.api.openstack.requestlog [None req-ccf64e31-900f-4757-8413-bf4c9b2211f2 tempest-VolumesGetTestJSON-505601620 tempest-VolumesGetTestJSON-505601620-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90" status: 404 len: 109 microversion: 2.1 time: 0.038810 Oct 05 14:21:28.641871 dv-cinder-835878-4-smb devstack@n-api.service[120646]: [pid: 120646|app: 0|req: 449/924] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 14:21:28 2022] GET /compute/v2.1/os-volumes/1849b39b-2e09-4c2c-a90f-474d6d31ec90 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)